-- Logs begin at Mon 2021-10-25 14:14:00 UTC, end at Mon 2021-10-25 15:17:13 UTC. -- Oct 25 14:38:36.731470 dv-cinder-813751-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 25 14:38:36.740795 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 25 14:38:36 2021] *** Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: nodename: dv-cinder-813751-1-iscsi Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: machine: x86_64 Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: clock source: unix Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: pcre jit disabled Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: detected number of CPU cores: 4 Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: current working directory: / Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: detected binary path: /usr/bin/uwsgi-core Oct 25 14:38:36.742818 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: your processes number limit is 47680 Oct 25 14:38:36.743531 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: your memory page size is 4096 bytes Oct 25 14:38:36.743531 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: detected max file descriptor number: 2048 Oct 25 14:38:36.743531 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: lock engine: pthread robust mutexes Oct 25 14:38:36.743531 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: thunder lock: enabled Oct 25 14:38:36.743531 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 25 14:38:36.743531 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 25 14:38:36.782183 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: Python main interpreter initialized at 0x55ea19db99c0 Oct 25 14:38:36.782183 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: python threads support enabled Oct 25 14:38:36.782183 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: your server socket listen backlog is limited to 100 connections Oct 25 14:38:36.782183 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: your mercy for graceful operations on workers is 90 seconds Oct 25 14:38:36.782540 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: mapped 403077 bytes (393 KB) for 2 cores Oct 25 14:38:36.782635 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: *** Operational MODE: preforking *** Oct 25 14:38:36.782905 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: *** uWSGI is running in multiple interpreter mode *** Oct 25 14:38:36.782905 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: spawned uWSGI master process (pid: 66551) Oct 25 14:38:36.783184 dv-cinder-813751-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 25 14:38:36.784274 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: spawned uWSGI worker 1 (pid: 66562, cores: 1) Oct 25 14:38:36.784946 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: spawned uWSGI worker 2 (pid: 66563, cores: 1) Oct 25 14:38:36.784946 dv-cinder-813751-1-iscsi devstack@keystone.service[66551]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 25 14:38:41.620071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 14:38:41.620071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: from cryptography.utils import int_from_bytes Oct 25 14:38:41.620864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 14:38:41.620864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: from cryptography.utils import int_from_bytes Oct 25 14:38:41.623138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 14:38:41.623138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: from cryptography.utils import int_from_bytes Oct 25 14:38:41.623602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 14:38:41.623602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: from cryptography.utils import int_from_bytes Oct 25 14:38:41.669576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 14:38:41.669769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 14:38:41.669959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] command line args: [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 14:38:41.670221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 14:38:41.670305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 14:38:41.670383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ================================================================================ {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 14:38:41.670519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 14:38:41.670663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] admin_token = **** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.670745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] command line args: [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 14:38:41.670897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] config_dir = [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.670992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 14:38:41.671072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.671150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ================================================================================ {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 14:38:41.671233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] config_source = [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.671385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] admin_token = **** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.671470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] debug = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.671592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.671838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] config_dir = [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.671838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.671960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] config_source = [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] debug = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] list_limit = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.672962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] log_config_append = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] log_dir = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] list_limit = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] log_file = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] log_config_append = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.673969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] log_dir = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] log_file = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.674972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.675946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.676064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.676172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.676308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.676413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.676568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.676696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.676825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.676904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.677614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.677830 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.677960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.678073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] publish_errors = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.678182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.678292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.678480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.678633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.678750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.678866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] publish_errors = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.678977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.679097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.679208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.679323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.679492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] standard_threads = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.679618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.679730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.679840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.679956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] standard_threads = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] use_journal = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] use_json = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] use_stderr = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.680977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] use_syslog = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.681090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.681206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.681316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] use_journal = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.681316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] use_json = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.681522 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.681641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] use_stderr = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.681760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.681870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] use_syslog = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.681985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.682096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 14:38:41.682216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.682338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.682478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.682593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.682715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.682827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.682936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.683124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.683237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.683346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.683462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.683574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.683683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.683805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.683917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684245 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.684925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685035 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.685938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.686941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687401 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.687969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.688078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.688187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.688296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.688479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.688598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.688708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.688708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.688926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689273 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689612 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.689967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.690082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.690194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.690309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.690438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.690566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.690679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.690814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.690930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691833 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.691952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.692063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.692174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.692283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.692399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.692510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.692666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.693274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.693389 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.693506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.693616 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.693725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.693828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.693924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.694971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695398 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.695966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.696078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.696195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.696316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.696437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.696557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.696678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.696796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.696907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.697978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.698100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.698215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.698330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.698465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.698579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.698690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.698810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.698913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699133 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699244 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.699910 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.700997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.701107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.701217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.701327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.701438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.701560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.701717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.701830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.701940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.702056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.702168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] auth.external = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.702286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.702451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.702566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.702677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.702788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.702897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] auth.password = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] auth.token = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] auth.external = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.703993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.704105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.704216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.704327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.704443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] auth.password = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.704567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.704716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] auth.token = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.704831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.704942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] credential.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.705973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.706086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.706197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.706316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.706442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.706561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] credential.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.706684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.706799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.706910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.707968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.708079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.708190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.708310 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.708431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.708543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.708655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.708767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.708883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] federation.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709920 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.709920 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.710134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.710246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.710366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] federation.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.710366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.710649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.710762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.710873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.711918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.712982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.713095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.713215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.713329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.713447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.713560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.713680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.713864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.713988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.714101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.714214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.714332 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.714458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.714584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.714699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.714810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.714923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.715835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716721 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.716960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717538 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.717992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.718105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.718217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.718330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.718483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.718598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.718722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.718836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.718948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.719964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.720087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.720201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.720313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.720425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.720536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.720648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.720767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.720887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721408 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.721984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.722918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.723131 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.723243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.723355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.723467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.723588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.723703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.723815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.723815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724025 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.724950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.725968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.726080 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.726199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.726313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.726473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.726599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.726715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.726828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.726948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727401 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.727980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.728997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.729110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.729222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.729335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.729446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.729558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.729682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.729797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.729910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730616 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.730952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731414 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.731990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] resource.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.732103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.732216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.732328 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.732448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.732561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.732770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.732887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.733001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.733113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.733234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.733348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.733461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.733572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.733684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] resource.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] role.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734631 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] role.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.734982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.735095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.735207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.735318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.735430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.735551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.735665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.735777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.735889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736113 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] role.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] role.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.736986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737436 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737782 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.737991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.738103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.738103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.738322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.738490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.738605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.738717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.738829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.738953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.739067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.739179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.739298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.739411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.740918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741834 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.741946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.742057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.742249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.742366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.742498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.742611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.742723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.742835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.742959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] token.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.743967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.744985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.745097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.745209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] token.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.745320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.745432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.745552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.745667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.745779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.745891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746629 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.746978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.connection = **** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747317 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.747987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.748197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.748316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.748430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.748542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.748654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.748767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.748879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.748999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.749113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.749225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.749336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.connection = **** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.749447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.749558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.749679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.749793 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.749905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.750961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 14:38:41.751657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.751657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.752372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.752372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 14:38:41.752372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 14:38:41.778875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.779114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.779306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.780065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.780302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.780528 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.789271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.790536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.821396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.821661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.821808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.821931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.877007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.877719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.929106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.929334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.930131 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:41.930374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.075592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.075829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.076041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.076183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.076315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.076447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.076578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.076723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.076856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.076986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.077116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.077116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.099984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.100212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.100337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.100470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.100603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.100734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.100883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.101016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.101145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.101274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.101274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.101522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.101522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.101759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.112874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.113009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.126192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.126429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.126617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.126712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.126851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.126977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.127110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.127205 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.127356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.127446 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.127548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.127633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.127709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.127896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 14:38:42.144685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.144888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 14:38:42.145043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.145226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.145343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 14:38:42.145425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 14:38:42.145674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.146325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.146470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.146551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 14:38:42.146710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.146796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.146961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.147056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.147305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.147563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.157265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.157534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.157797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.157967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.158073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.158246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.158546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.158838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.166803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.167519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.169946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.170226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.170531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.170718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.170802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.170997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.171079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.171282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.171366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.171560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.171644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.171827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.171908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.172084 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.172172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.172347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.172428 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.172607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.172688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.172872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.173143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.173412 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.199896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.200987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.201450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.201730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.202596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.202881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.206928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.207202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.207476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.207948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.208751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.209034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.215006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.215276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.216193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.216475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.219595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.219874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.220145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.220417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.220681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.220790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.220948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.221108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.221255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.221342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.221496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.221621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.221902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.222171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.222460 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.222732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.240629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.240911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.241821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.242104 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.245378 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.246601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.249029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.249317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.250234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.250558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.254150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.255494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.257659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.259002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.261190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.261476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.261752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.262033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.262305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.262542 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.262627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.262842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.263125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.263417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.263696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.263981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.281822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.282101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.282362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.282642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.283303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.283589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.283856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.284125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.290892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.292270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.292533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.292813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.294060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.294341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.295748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.296025 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.296296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.296579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.296881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.297293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.297576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.297856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.298144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.298462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.310343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.310654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.310932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.311216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.311491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.311759 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.312029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.312111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.312338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.312626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.312916 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.313199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.313481 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.313758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.330045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.331946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.334094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.335932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.337560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.339226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.339726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.340840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.341122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.341359 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.341442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.343031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.343320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.343612 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.348840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.351083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.351462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.353224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.354281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.354609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.354890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.355167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.356484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.356788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.357085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.357368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.364725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.365020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.365306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.366853 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.367162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.367452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.373104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.373393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.373673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.373940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.374203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.374508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.374791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.375053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.375314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.375395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 14:38:42.375580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.375670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.375844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.375925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.376117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.376198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.376376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.376468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.376637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.376719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.376949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.377266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.377485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.377759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.378026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.378314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.378593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.378858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 14:38:42.414418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea19db99c0 pid: 66562 (default app) Oct 25 14:38:42.416711 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea19db99c0 pid: 66563 (default app) Oct 25 14:38:42.418771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627c3f-9568-4d0c-8240-67077fe88c5d None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:42.419080 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627c3f-9568-4d0c-8240-67077fe88c5d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:42.419375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627c3f-9568-4d0c-8240-67077fe88c5d None None] PATH_INFO: `/v3` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:42.423467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Mon Oct 25 14:38:42 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:38:49.749533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1260f3-2f99-4c41-a1b7-bc1d2dff1194 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:49.750122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1260f3-2f99-4c41-a1b7-bc1d2dff1194 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:49.750122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1260f3-2f99-4c41-a1b7-bc1d2dff1194 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:49.756089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:38:49 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:38:49.761444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:49.761892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:49.762011 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:49.802322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG oslo_db.sqlalchemy.engines [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Oct 25 14:38:49.955124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG passlib.handlers.bcrypt [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66562) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 25 14:38:49.955532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG passlib.handlers.bcrypt [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66562) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 25 14:38:50.017143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:38:50.018647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:38:50.155496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:38:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:38:50.319638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1260f3-2f99-4c41-a1b7-bc1d2dff1194 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:50.361925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG oslo_db.sqlalchemy.engines [None req-7e1260f3-2f99-4c41-a1b7-bc1d2dff1194 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Oct 25 14:38:50.457529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1260f3-2f99-4c41-a1b7-bc1d2dff1194 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:50.461529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b3e62-4cee-4bd0-be88-690549be6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:50.462122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3e62-4cee-4bd0-be88-690549be6fac admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:50.462423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3e62-4cee-4bd0-be88-690549be6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:50.462713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3e62-4cee-4bd0-be88-690549be6fac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:50.470786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b3e62-4cee-4bd0-be88-690549be6fac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:50.521874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.common.rbac_enforcer.enforcer [None req-720b3e62-4cee-4bd0-be88-690549be6fac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 25 14:38:50.522208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b3e62-4cee-4bd0-be88-690549be6fac admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:50.531832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:38:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:38:50.538131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:50.549383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a0d8-2d9e-4841-b70d-dbc869ecc821 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:50.554234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f9e18-bbd1-40dc-a164-af94cda2e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:50.555433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9e18-bbd1-40dc-a164-af94cda2e1af admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:50.555735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9e18-bbd1-40dc-a164-af94cda2e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:50.556021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9e18-bbd1-40dc-a164-af94cda2e1af admin admin] PATH_INFO: `/v3/projects/8de23d66a8de47dbaa30df02a935afe2` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:50.557396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f9e18-bbd1-40dc-a164-af94cda2e1af admin admin] RBAC: Authorizing `identity:get_project(project_id=8de23d66a8de47dbaa30df02a935afe2)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:50.608311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d19f9e18-bbd1-40dc-a164-af94cda2e1af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 25 14:38:50.608570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f9e18-bbd1-40dc-a164-af94cda2e1af admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:50.613423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:38:50 2021] GET /identity/v3/projects/8de23d66a8de47dbaa30df02a935afe2 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:38:52.722335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68990-4ce8-4b78-9f01-79e64a0a2c17 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:52.722900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68990-4ce8-4b78-9f01-79e64a0a2c17 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:52.723049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68990-4ce8-4b78-9f01-79e64a0a2c17 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:52.728068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:38:52 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:38:52.733468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2218e-d1a8-461d-9019-83c30f5130fd None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:52.734095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2218e-d1a8-461d-9019-83c30f5130fd None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:52.734287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2218e-d1a8-461d-9019-83c30f5130fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:52.757202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5cb2218e-d1a8-461d-9019-83c30f5130fd None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:38:52.758727 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5cb2218e-d1a8-461d-9019-83c30f5130fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:38:52.765789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:38:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:38:52.788604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68990-4ce8-4b78-9f01-79e64a0a2c17 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:52.800478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68990-4ce8-4b78-9f01-79e64a0a2c17 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:52.804415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980a088-96ab-4ce9-9c8f-b9c95adb06f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:52.804981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a088-96ab-4ce9-9c8f-b9c95adb06f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:52.805271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a088-96ab-4ce9-9c8f-b9c95adb06f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:52.805550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a088-96ab-4ce9-9c8f-b9c95adb06f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:52.813382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980a088-96ab-4ce9-9c8f-b9c95adb06f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:52.815185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980a088-96ab-4ce9-9c8f-b9c95adb06f2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:52.823582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:38:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:38:52.829405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2218e-d1a8-461d-9019-83c30f5130fd None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:52.838967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2218e-d1a8-461d-9019-83c30f5130fd None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:52.843013 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46c11-f2ec-4675-88af-b5f95c273bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:52.843806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c11-f2ec-4675-88af-b5f95c273bca admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:52.844094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c11-f2ec-4675-88af-b5f95c273bca admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:52.844372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c11-f2ec-4675-88af-b5f95c273bca admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:52.845659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46c11-f2ec-4675-88af-b5f95c273bca admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:52.847531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46c11-f2ec-4675-88af-b5f95c273bca admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:52.849604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:38:52 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:38:55.064374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01842-7fbd-4c48-9c23-d2e0747ecd25 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:55.064897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01842-7fbd-4c48-9c23-d2e0747ecd25 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:55.065005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01842-7fbd-4c48-9c23-d2e0747ecd25 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:55.066603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:38:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:38:55.072328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cccef-5fdb-46f2-bef1-506af7dae505 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:55.072731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cccef-5fdb-46f2-bef1-506af7dae505 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:55.072949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cccef-5fdb-46f2-bef1-506af7dae505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:55.094585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e18cccef-5fdb-46f2-bef1-506af7dae505 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:38:55.095735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e18cccef-5fdb-46f2-bef1-506af7dae505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:38:55.102765 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:38:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:38:55.125718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de01842-7fbd-4c48-9c23-d2e0747ecd25 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:55.138024 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de01842-7fbd-4c48-9c23-d2e0747ecd25 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:55.141960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549707-f202-48bb-bf1d-bce5ebd896c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:55.142706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549707-f202-48bb-bf1d-bce5ebd896c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:55.142996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549707-f202-48bb-bf1d-bce5ebd896c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:55.143278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549707-f202-48bb-bf1d-bce5ebd896c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:55.155786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549707-f202-48bb-bf1d-bce5ebd896c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:38:55.162150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-e0549707-f202-48bb-bf1d-bce5ebd896c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:38:55.163289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 6/12] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:38:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:38:55.169121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cccef-5fdb-46f2-bef1-506af7dae505 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:55.178309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cccef-5fdb-46f2-bef1-506af7dae505 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:55.182475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:55.183071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:55.183363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:55.183648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:55.184370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:38:55.184678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:55.186395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:38:55.186395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:38:55.186395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:38:55.187334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:55.198708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 7/13] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:38:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:38:55.204434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549707-f202-48bb-bf1d-bce5ebd896c2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:55.213795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549707-f202-48bb-bf1d-bce5ebd896c2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:55.217899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73504d57-c1fe-473b-a4a7-b5887ea14aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:55.218722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73504d57-c1fe-473b-a4a7-b5887ea14aae admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:55.219011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73504d57-c1fe-473b-a4a7-b5887ea14aae admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:55.219293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73504d57-c1fe-473b-a4a7-b5887ea14aae admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:55.220896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73504d57-c1fe-473b-a4a7-b5887ea14aae admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:55.222773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73504d57-c1fe-473b-a4a7-b5887ea14aae admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:55.224283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:38:55 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:38:55.230023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:55.241028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91b5ab-ec16-4ffd-abd5-9530e9490589 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:55.245314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5bb39-af8a-47b2-acf8-3bb99591a382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:55.246072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bb39-af8a-47b2-acf8-3bb99591a382 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:55.246366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bb39-af8a-47b2-acf8-3bb99591a382 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:55.246930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bb39-af8a-47b2-acf8-3bb99591a382 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:55.247878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5bb39-af8a-47b2-acf8-3bb99591a382 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:55.249659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5bb39-af8a-47b2-acf8-3bb99591a382 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:55.251246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:38:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:38:55.257972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73504d57-c1fe-473b-a4a7-b5887ea14aae admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:55.268009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73504d57-c1fe-473b-a4a7-b5887ea14aae admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:55.272331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7310b-4087-467c-9734-033828df09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:55.272916 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7310b-4087-467c-9734-033828df09ab admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:55.273204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7310b-4087-467c-9734-033828df09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:55.273484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7310b-4087-467c-9734-033828df09ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:55.274278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7310b-4087-467c-9734-033828df09ab admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.domain.id=default, user.id=c3aab5572b2c402b81621b54bfffba2e) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:38:55.274620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7310b-4087-467c-9734-033828df09ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:55.276382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-16f7310b-4087-467c-9734-033828df09ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:38:55.276382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:38:55.276382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:38:55.277556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7310b-4087-467c-9734-033828df09ab admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:55.284934 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 8/16] 10.222.0.57 () {56 vars in 1343 bytes} [Mon Oct 25 14:38:55 2021] GET /identity/v3/role_assignments?user.id=c3aab5572b2c402b81621b54bfffba2e&scope.domain.id=default&role.id=98f77a1006404111a8be8686551c8675 => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:38:57.355699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249456b5-6dd2-4a8e-befd-24f7d23fb2e3 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:57.356220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249456b5-6dd2-4a8e-befd-24f7d23fb2e3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:57.356325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249456b5-6dd2-4a8e-befd-24f7d23fb2e3 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:57.358195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 9/17] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:38:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:38:57.363628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:57.364505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:57.364685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:57.396604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG passlib.handlers.bcrypt [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66563) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 25 14:38:57.397009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG passlib.handlers.bcrypt [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66563) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 25 14:38:57.443668 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:38:57.445197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:38:57.480348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 9/18] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:38:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:38:57.503278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249456b5-6dd2-4a8e-befd-24f7d23fb2e3 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:57.516357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249456b5-6dd2-4a8e-befd-24f7d23fb2e3 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:57.520475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea168f-f83d-4e55-af9b-3c8826daaf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:57.521221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea168f-f83d-4e55-af9b-3c8826daaf0b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:57.521512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea168f-f83d-4e55-af9b-3c8826daaf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:57.521794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea168f-f83d-4e55-af9b-3c8826daaf0b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:57.534306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea168f-f83d-4e55-af9b-3c8826daaf0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:38:57.541473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-97ea168f-f83d-4e55-af9b-3c8826daaf0b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:38:57.542683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:38:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:38:57.548577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:57.558090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa48aa9-391e-4384-9abd-12c2ac2b9e98 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:57.562248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:57.563171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:57.563469 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:57.563751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:57.564606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:38:57.564905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:57.565945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:38:57.565945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:38:57.565945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:38:57.566896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:57.576613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:38:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:38:57.582359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea168f-f83d-4e55-af9b-3c8826daaf0b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:57.592133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea168f-f83d-4e55-af9b-3c8826daaf0b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:57.596298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bcca6-1823-43d7-b663-39d468090f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:57.596994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bcca6-1823-43d7-b663-39d468090f85 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:57.597285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bcca6-1823-43d7-b663-39d468090f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:57.597568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bcca6-1823-43d7-b663-39d468090f85 admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:57.599184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bcca6-1823-43d7-b663-39d468090f85 admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:57.601058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bcca6-1823-43d7-b663-39d468090f85 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:57.602483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:38:57 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:38:57.607583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:57.617520 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e97f5e-cf15-4c42-85e8-c0871d019a15 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:57.621556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f70e0-8fa9-48cb-b0d4-972beada7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:57.622458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f70e0-8fa9-48cb-b0d4-972beada7d21 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:57.622595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f70e0-8fa9-48cb-b0d4-972beada7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:57.622879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f70e0-8fa9-48cb-b0d4-972beada7d21 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:57.624147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f70e0-8fa9-48cb-b0d4-972beada7d21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:57.625825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f70e0-8fa9-48cb-b0d4-972beada7d21 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:57.627247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 11/22] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:38:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:38:57.632465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bcca6-1823-43d7-b663-39d468090f85 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:38:57.641867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bcca6-1823-43d7-b663-39d468090f85 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:38:57.645957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fd05f-0d80-40d7-a3e4-652e459614d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:38:57.646778 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fd05f-0d80-40d7-a3e4-652e459614d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:57.647070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fd05f-0d80-40d7-a3e4-652e459614d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:57.647356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fd05f-0d80-40d7-a3e4-652e459614d9 admin admin] PATH_INFO: `/v3/domains/default/users/c3aab5572b2c402b81621b54bfffba2e/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:57.649190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fd05f-0d80-40d7-a3e4-652e459614d9 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c3aab5572b2c402b81621b54bfffba2e, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:38:57.650185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-325fd05f-0d80-40d7-a3e4-652e459614d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:38:57.650185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:38:57.650185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:38:57.652219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fd05f-0d80-40d7-a3e4-652e459614d9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:38:57.850601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1382 bytes} [Mon Oct 25 14:38:57 2021] PUT /identity/v3/domains/default/users/c3aab5572b2c402b81621b54bfffba2e/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:38:59.904519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f8f7-a0e6-44f5-9f04-b3707fafd67f None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:59.905053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f8f7-a0e6-44f5-9f04-b3707fafd67f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:59.905053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f8f7-a0e6-44f5-9f04-b3707fafd67f None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:59.906772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:38:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:38:59.912317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eab02-ca96-4e97-93db-ee91565bf25c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:38:59.912694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eab02-ca96-4e97-93db-ee91565bf25c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:38:59.912897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eab02-ca96-4e97-93db-ee91565bf25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:38:59.935700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7b5eab02-ca96-4e97-93db-ee91565bf25c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:38:59.937185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7b5eab02-ca96-4e97-93db-ee91565bf25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:00.001168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 13/25] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:38:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:00.024857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907f8f7-a0e6-44f5-9f04-b3707fafd67f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:00.036750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907f8f7-a0e6-44f5-9f04-b3707fafd67f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:00.040672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93426591-4ae5-48da-8c11-9c066b00ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:00.041385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426591-4ae5-48da-8c11-9c066b00ce8f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:00.041672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426591-4ae5-48da-8c11-9c066b00ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:00.041949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426591-4ae5-48da-8c11-9c066b00ce8f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:00.053686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93426591-4ae5-48da-8c11-9c066b00ce8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:00.060169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-93426591-4ae5-48da-8c11-9c066b00ce8f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:39:00.061347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 13/26] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:39:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:00.068044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eab02-ca96-4e97-93db-ee91565bf25c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:00.077452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eab02-ca96-4e97-93db-ee91565bf25c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:00.081662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:00.082297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:00.082723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:00.083521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:00.084267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:00.084573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:00.086545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:00.098943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 14/27] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:00.104521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93426591-4ae5-48da-8c11-9c066b00ce8f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:00.114329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93426591-4ae5-48da-8c11-9c066b00ce8f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:00.118527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f60543-8522-4126-9b08-08023085f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:00.119314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f60543-8522-4126-9b08-08023085f4de admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:00.119603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f60543-8522-4126-9b08-08023085f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:00.119882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f60543-8522-4126-9b08-08023085f4de admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:00.121172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f60543-8522-4126-9b08-08023085f4de admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:00.123040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f60543-8522-4126-9b08-08023085f4de admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:00.124485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 14/28] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:00 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:00.130700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:00.140263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df0627-d8f5-4c5c-b959-c94bd2cdbadc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:00.144419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdce4-c8e3-40ba-8720-5ca13e4e64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:00.145220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdce4-c8e3-40ba-8720-5ca13e4e64fc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:00.146009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdce4-c8e3-40ba-8720-5ca13e4e64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:00.146297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdce4-c8e3-40ba-8720-5ca13e4e64fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:00.147446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cdce4-c8e3-40ba-8720-5ca13e4e64fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:00.149205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cdce4-c8e3-40ba-8720-5ca13e4e64fc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:00.150728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 15/29] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:39:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:00.156459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f60543-8522-4126-9b08-08023085f4de admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:00.165857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f60543-8522-4126-9b08-08023085f4de admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:00.169986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c351-9ff1-4d61-93de-be405a109cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:00.170587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c351-9ff1-4d61-93de-be405a109cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:00.170880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c351-9ff1-4d61-93de-be405a109cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:00.171160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c351-9ff1-4d61-93de-be405a109cb7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:00.171936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c351-9ff1-4d61-93de-be405a109cb7 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.domain.id=default, user.id=c3aab5572b2c402b81621b54bfffba2e) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:00.172240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c351-9ff1-4d61-93de-be405a109cb7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:00.174101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c351-9ff1-4d61-93de-be405a109cb7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:00.182206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 15/30] 10.222.0.57 () {56 vars in 1343 bytes} [Mon Oct 25 14:39:00 2021] GET /identity/v3/role_assignments?user.id=c3aab5572b2c402b81621b54bfffba2e&scope.domain.id=default&role.id=98f77a1006404111a8be8686551c8675 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:02.331689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e768a9-5efb-46a3-8e1e-2d2f2b67c653 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:02.332207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e768a9-5efb-46a3-8e1e-2d2f2b67c653 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:02.332293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e768a9-5efb-46a3-8e1e-2d2f2b67c653 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:02.334555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 16/31] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:02.339682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53cc9-ad38-4faa-9b6b-dc686667410d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:02.340073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53cc9-ad38-4faa-9b6b-dc686667410d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:02.340252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53cc9-ad38-4faa-9b6b-dc686667410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:02.362748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-58d53cc9-ad38-4faa-9b6b-dc686667410d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:02.363940 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-58d53cc9-ad38-4faa-9b6b-dc686667410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:02.370856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 16/32] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:02.393138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e768a9-5efb-46a3-8e1e-2d2f2b67c653 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:02.405474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e768a9-5efb-46a3-8e1e-2d2f2b67c653 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:02.409446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af172105-5ae7-4623-a26b-b4df07474217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:02.410024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172105-5ae7-4623-a26b-b4df07474217 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:02.410320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172105-5ae7-4623-a26b-b4df07474217 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:02.410660 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172105-5ae7-4623-a26b-b4df07474217 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:02.418250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af172105-5ae7-4623-a26b-b4df07474217 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:02.420048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af172105-5ae7-4623-a26b-b4df07474217 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:02.429287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 17/33] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:39:02.434971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d53cc9-ad38-4faa-9b6b-dc686667410d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:02.444796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d53cc9-ad38-4faa-9b6b-dc686667410d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:02.449163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbaa1c-1153-44fd-8269-3a850b07d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:02.449952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbaa1c-1153-44fd-8269-3a850b07d580 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:02.450243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbaa1c-1153-44fd-8269-3a850b07d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:02.450560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbaa1c-1153-44fd-8269-3a850b07d580 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:02.451717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbaa1c-1153-44fd-8269-3a850b07d580 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:02.453470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbaa1c-1153-44fd-8269-3a850b07d580 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:02.455052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 17/34] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:39:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:04.614073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd19ad-f6ff-448e-b2c1-511d9ee1253f None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:04.614627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd19ad-f6ff-448e-b2c1-511d9ee1253f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:04.614731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd19ad-f6ff-448e-b2c1-511d9ee1253f None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:04.616457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 18/35] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:04.621575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed24e8-6c5f-431c-8500-251495992104 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:04.621965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed24e8-6c5f-431c-8500-251495992104 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:04.622129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed24e8-6c5f-431c-8500-251495992104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:04.644095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-32ed24e8-6c5f-431c-8500-251495992104 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:04.645847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-32ed24e8-6c5f-431c-8500-251495992104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:04.652625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 18/36] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:04.674745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd19ad-f6ff-448e-b2c1-511d9ee1253f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:04.686881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd19ad-f6ff-448e-b2c1-511d9ee1253f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:04.690811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:04.691528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:04.692570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:04.692867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:04.704147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:04.706034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:04.722725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:39:04.723808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 19/37] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:39:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:04.729551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed24e8-6c5f-431c-8500-251495992104 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:04.738392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed24e8-6c5f-431c-8500-251495992104 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:04.742993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeffc2d-00c3-4245-8b89-79b9a5a45381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:04.743590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeffc2d-00c3-4245-8b89-79b9a5a45381 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:04.743879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeffc2d-00c3-4245-8b89-79b9a5a45381 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:04.744158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeffc2d-00c3-4245-8b89-79b9a5a45381 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:04.744858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeffc2d-00c3-4245-8b89-79b9a5a45381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:04.745160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeffc2d-00c3-4245-8b89-79b9a5a45381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:04.746170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-8aeffc2d-00c3-4245-8b89-79b9a5a45381 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:39:04.746170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:39:04.746170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:39:04.747151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeffc2d-00c3-4245-8b89-79b9a5a45381 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:04.764556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 19/38] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:39:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:04.770456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:04.780295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954767d-2814-432f-998e-e6cc324a077b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:04.784471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065946e6-10f8-4f94-9da2-959eb4ec575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:04.785064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065946e6-10f8-4f94-9da2-959eb4ec575e admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:04.785357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065946e6-10f8-4f94-9da2-959eb4ec575e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:04.785666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065946e6-10f8-4f94-9da2-959eb4ec575e admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:04.786329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065946e6-10f8-4f94-9da2-959eb4ec575e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:04.787373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-065946e6-10f8-4f94-9da2-959eb4ec575e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:39:04.787373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:39:04.787373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:39:04.788578 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065946e6-10f8-4f94-9da2-959eb4ec575e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:04.819050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 20/39] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:39:04 2021] POST /identity/v3/projects => generated 301 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:39:06.994680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079d082-638f-42d3-a051-d3c7490f851a None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:06.995177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079d082-638f-42d3-a051-d3c7490f851a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:06.995260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079d082-638f-42d3-a051-d3c7490f851a None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:06.996932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 20/40] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:07.001938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842a2db-e884-4958-acd3-6cce1bb0eb45 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:07.002297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842a2db-e884-4958-acd3-6cce1bb0eb45 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:07.002552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842a2db-e884-4958-acd3-6cce1bb0eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:07.025098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-6842a2db-e884-4958-acd3-6cce1bb0eb45 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:07.026242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6842a2db-e884-4958-acd3-6cce1bb0eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:07.090052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 21/41] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:07.112598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079d082-638f-42d3-a051-d3c7490f851a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:07.124457 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079d082-638f-42d3-a051-d3c7490f851a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:07.128423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca508a5-1ac3-4a32-bbf2-4df7f1e27d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:07.129011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca508a5-1ac3-4a32-bbf2-4df7f1e27d76 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:07.129304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca508a5-1ac3-4a32-bbf2-4df7f1e27d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:07.129588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca508a5-1ac3-4a32-bbf2-4df7f1e27d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:07.130296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca508a5-1ac3-4a32-bbf2-4df7f1e27d76 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:07.131353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-bca508a5-1ac3-4a32-bbf2-4df7f1e27d76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:39:07.131353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:39:07.131353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:39:07.132262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca508a5-1ac3-4a32-bbf2-4df7f1e27d76 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:07.338267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 21/42] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:39:07 2021] POST /identity/v3/roles => generated 219 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:39:09.491318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7d56-1d3c-4f0b-b64b-e68e0af4b989 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:09.491867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7d56-1d3c-4f0b-b64b-e68e0af4b989 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:09.491867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7d56-1d3c-4f0b-b64b-e68e0af4b989 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:09.493579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 22/43] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:09.499073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22507b-a955-498d-a1bb-575fae6d2c29 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:09.499458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22507b-a955-498d-a1bb-575fae6d2c29 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:09.499652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22507b-a955-498d-a1bb-575fae6d2c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:09.523279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1f22507b-a955-498d-a1bb-575fae6d2c29 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:09.524747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1f22507b-a955-498d-a1bb-575fae6d2c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:09.531912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 22/44] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:09.555234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d7d56-1d3c-4f0b-b64b-e68e0af4b989 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:09.567034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d7d56-1d3c-4f0b-b64b-e68e0af4b989 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:09.570965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b8bc-7b7e-44ec-9421-ca41901aa928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:09.571553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b8bc-7b7e-44ec-9421-ca41901aa928 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:09.571845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b8bc-7b7e-44ec-9421-ca41901aa928 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:09.572131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b8bc-7b7e-44ec-9421-ca41901aa928 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:09.572832 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05b8bc-7b7e-44ec-9421-ca41901aa928 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:09.573844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-9c05b8bc-7b7e-44ec-9421-ca41901aa928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:39:09.573844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:39:09.573844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:39:09.574813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05b8bc-7b7e-44ec-9421-ca41901aa928 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:09.587889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 23/45] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:39:09 2021] POST /identity/v3/roles => generated 225 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:39:11.783572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bceb2-af1b-4206-94db-092e0070fa65 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:11.784101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bceb2-af1b-4206-94db-092e0070fa65 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:11.784238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bceb2-af1b-4206-94db-092e0070fa65 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:11.785931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 23/46] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:11.791184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5399d98-08d5-44ad-8359-cfe317c37f87 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:11.791581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5399d98-08d5-44ad-8359-cfe317c37f87 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:11.791870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5399d98-08d5-44ad-8359-cfe317c37f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:11.813650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f5399d98-08d5-44ad-8359-cfe317c37f87 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:11.814836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f5399d98-08d5-44ad-8359-cfe317c37f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:11.822352 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 24/47] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:39:11.844708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bceb2-af1b-4206-94db-092e0070fa65 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:11.856471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bceb2-af1b-4206-94db-092e0070fa65 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:11.860562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df989b6-b79b-40f2-a216-ecb94199e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:11.861144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df989b6-b79b-40f2-a216-ecb94199e610 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:11.861433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df989b6-b79b-40f2-a216-ecb94199e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:11.861720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df989b6-b79b-40f2-a216-ecb94199e610 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:11.862427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df989b6-b79b-40f2-a216-ecb94199e610 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:11.864219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df989b6-b79b-40f2-a216-ecb94199e610 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:11.876380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 24/48] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:39:11 2021] POST /identity/v3/roles => generated 223 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:39:13.976334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3ed4-9753-4e1f-889a-442dc9113105 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:13.976907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3ed4-9753-4e1f-889a-442dc9113105 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:13.976907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3ed4-9753-4e1f-889a-442dc9113105 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:13.978625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 25/49] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:13.983691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473487-e618-4b5f-8cad-a5c07529b261 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:13.984369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473487-e618-4b5f-8cad-a5c07529b261 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:13.984527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473487-e618-4b5f-8cad-a5c07529b261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:14.007449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4d473487-e618-4b5f-8cad-a5c07529b261 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:14.008597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4d473487-e618-4b5f-8cad-a5c07529b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:14.015441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 25/50] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:14.038230 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3ed4-9753-4e1f-889a-442dc9113105 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:14.050081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3ed4-9753-4e1f-889a-442dc9113105 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:14.054663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61265593-d322-4d05-957c-0c39b9fbdfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:14.055383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265593-d322-4d05-957c-0c39b9fbdfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:14.055675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265593-d322-4d05-957c-0c39b9fbdfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:14.055959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265593-d322-4d05-957c-0c39b9fbdfb7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:14.057053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265593-d322-4d05-957c-0c39b9fbdfb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:14.058820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265593-d322-4d05-957c-0c39b9fbdfb7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:14.060284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 26/51] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:39:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:14.065671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473487-e618-4b5f-8cad-a5c07529b261 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:14.074688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473487-e618-4b5f-8cad-a5c07529b261 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:14.078722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c009-c554-47db-a34d-cfcf5607b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:14.079313 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c009-c554-47db-a34d-cfcf5607b192 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:14.079608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c009-c554-47db-a34d-cfcf5607b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:14.079898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c009-c554-47db-a34d-cfcf5607b192 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:14.080562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c009-c554-47db-a34d-cfcf5607b192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:14.081572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-5ea3c009-c554-47db-a34d-cfcf5607b192 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:39:14.081572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:39:14.081572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:39:14.084886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c009-c554-47db-a34d-cfcf5607b192 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:14.116747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 26/52] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:39:14 2021] POST /identity/v3/projects => generated 312 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:39:16.217444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcdb22-a48d-4ddf-992a-914209a30fbe None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:16.217946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcdb22-a48d-4ddf-992a-914209a30fbe None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:16.217946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcdb22-a48d-4ddf-992a-914209a30fbe None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:16.219661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 27/53] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:16.225336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dd44-99dc-4f4d-99f3-fb4456dbc05a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:16.225774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dd44-99dc-4f4d-99f3-fb4456dbc05a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:16.225904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dd44-99dc-4f4d-99f3-fb4456dbc05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:16.248355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4005dd44-99dc-4f4d-99f3-fb4456dbc05a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:16.249493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4005dd44-99dc-4f4d-99f3-fb4456dbc05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:16.313725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 27/54] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:39:16.337402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcdb22-a48d-4ddf-992a-914209a30fbe None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:16.350970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcdb22-a48d-4ddf-992a-914209a30fbe None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:16.354837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7de4d-b26f-4585-9318-73ef2d8943f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:16.355563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7de4d-b26f-4585-9318-73ef2d8943f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:16.355875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7de4d-b26f-4585-9318-73ef2d8943f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:16.356160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7de4d-b26f-4585-9318-73ef2d8943f8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:16.357263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7de4d-b26f-4585-9318-73ef2d8943f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:16.359298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7de4d-b26f-4585-9318-73ef2d8943f8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:16.360862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 28/55] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:39:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:16.366861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005dd44-99dc-4f4d-99f3-fb4456dbc05a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:16.376164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005dd44-99dc-4f4d-99f3-fb4456dbc05a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:16.381070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763c127-69ec-45d6-b65e-0e694462a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:16.381694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c127-69ec-45d6-b65e-0e694462a34f admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:16.381991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c127-69ec-45d6-b65e-0e694462a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:16.382282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c127-69ec-45d6-b65e-0e694462a34f admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:16.383017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c127-69ec-45d6-b65e-0e694462a34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:16.385003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c127-69ec-45d6-b65e-0e694462a34f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:16.413245 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 28/56] 10.222.0.57 () {60 vars in 1161 bytes} [Mon Oct 25 14:39:16 2021] POST /identity/v3/projects => generated 298 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:39:18.548353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566d44-d96b-4844-bcf1-ffa56544975f None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:18.548872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566d44-d96b-4844-bcf1-ffa56544975f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:18.548974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566d44-d96b-4844-bcf1-ffa56544975f None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:18.550639 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 29/57] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:18.556250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef189b-1283-4f3e-9381-bb176508e371 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:18.556693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef189b-1283-4f3e-9381-bb176508e371 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:18.556827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef189b-1283-4f3e-9381-bb176508e371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:18.578577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-caef189b-1283-4f3e-9381-bb176508e371 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:18.579739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-caef189b-1283-4f3e-9381-bb176508e371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:18.645865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 29/58] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:18.670562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f566d44-d96b-4844-bcf1-ffa56544975f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:18.683438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f566d44-d96b-4844-bcf1-ffa56544975f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:18.687548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1634e4-c6c3-447d-a0b8-95c05fff21a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:18.688293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1634e4-c6c3-447d-a0b8-95c05fff21a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:18.688591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1634e4-c6c3-447d-a0b8-95c05fff21a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:18.688873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1634e4-c6c3-447d-a0b8-95c05fff21a4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:18.690016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1634e4-c6c3-447d-a0b8-95c05fff21a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:18.691780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1634e4-c6c3-447d-a0b8-95c05fff21a4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:18.693291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 30/59] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:39:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:18.698886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef189b-1283-4f3e-9381-bb176508e371 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:18.707857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef189b-1283-4f3e-9381-bb176508e371 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:18.716292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16743c-65fc-4043-9076-13cdcae821a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:18.716951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16743c-65fc-4043-9076-13cdcae821a8 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:18.717246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16743c-65fc-4043-9076-13cdcae821a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:18.717534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16743c-65fc-4043-9076-13cdcae821a8 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:18.718223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16743c-65fc-4043-9076-13cdcae821a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:18.719282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-2a16743c-65fc-4043-9076-13cdcae821a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:39:18.719282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:39:18.719282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:39:18.720535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16743c-65fc-4043-9076-13cdcae821a8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:18.746653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 30/60] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:39:18 2021] POST /identity/v3/users => generated 275 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:39:21.415015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5003f7-1b13-42d8-ac0f-727914574f7c None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:21.415569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5003f7-1b13-42d8-ac0f-727914574f7c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:21.415569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5003f7-1b13-42d8-ac0f-727914574f7c None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:21.417260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 31/61] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:21.422502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5dbe-0b4c-43ea-b5a7-459c1f318d6e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:21.422868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5dbe-0b4c-43ea-b5a7-459c1f318d6e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:21.423075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5dbe-0b4c-43ea-b5a7-459c1f318d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:21.447784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6ccf5dbe-0b4c-43ea-b5a7-459c1f318d6e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:21.448926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6ccf5dbe-0b4c-43ea-b5a7-459c1f318d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:21.455707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 31/62] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:39:21.478062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5003f7-1b13-42d8-ac0f-727914574f7c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:21.490431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5003f7-1b13-42d8-ac0f-727914574f7c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:21.494369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d217-672e-4e1e-a480-d1b152a709ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:21.495115 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d217-672e-4e1e-a480-d1b152a709ec admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:21.495405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d217-672e-4e1e-a480-d1b152a709ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:21.495685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d217-672e-4e1e-a480-d1b152a709ec admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:21.507225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d217-672e-4e1e-a480-d1b152a709ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:21.513882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-be00d217-672e-4e1e-a480-d1b152a709ec admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:21.515100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 32/63] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:21.521166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf5dbe-0b4c-43ea-b5a7-459c1f318d6e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:21.531017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf5dbe-0b4c-43ea-b5a7-459c1f318d6e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:21.535885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:21.536507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:21.536801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:21.537088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:21.537832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:21.538136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:21.539848 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:21.549266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 32/64] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:21.555445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d217-672e-4e1e-a480-d1b152a709ec admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:21.565379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d217-672e-4e1e-a480-d1b152a709ec admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:21.569608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987b45-ba0e-4dea-a316-f37bead209c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:21.570421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987b45-ba0e-4dea-a316-f37bead209c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:21.570740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987b45-ba0e-4dea-a316-f37bead209c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:21.571027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987b45-ba0e-4dea-a316-f37bead209c8 admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:21.589321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0987b45-ba0e-4dea-a316-f37bead209c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:21.591523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0987b45-ba0e-4dea-a316-f37bead209c8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:21.593072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 33/65] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:21 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:21.599251 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:21.616934 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b343801-7dda-437c-99dd-2916c06f48a7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:21.623721 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a23f-423f-4baf-8c79-35ae99dd048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:21.624715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a23f-423f-4baf-8c79-35ae99dd048e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:21.625231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a23f-423f-4baf-8c79-35ae99dd048e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:21.625739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a23f-423f-4baf-8c79-35ae99dd048e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:21.640404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552a23f-423f-4baf-8c79-35ae99dd048e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:21.642764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552a23f-423f-4baf-8c79-35ae99dd048e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:21.652769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 33/66] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:39:21.658482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987b45-ba0e-4dea-a316-f37bead209c8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:21.668411 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987b45-ba0e-4dea-a316-f37bead209c8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:21.672419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b6091-a09b-4b0f-8622-5fbaa851398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:21.673211 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b6091-a09b-4b0f-8622-5fbaa851398b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:21.673502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b6091-a09b-4b0f-8622-5fbaa851398b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:21.673787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b6091-a09b-4b0f-8622-5fbaa851398b admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:21.674902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b6091-a09b-4b0f-8622-5fbaa851398b admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:21.677661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b6091-a09b-4b0f-8622-5fbaa851398b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:21.679232 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 34/67] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:21 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:21.684947 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a23f-423f-4baf-8c79-35ae99dd048e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:21.693959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a23f-423f-4baf-8c79-35ae99dd048e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:21.698215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e628-8f88-4478-9aaf-c47a7e430643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:21.698835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e628-8f88-4478-9aaf-c47a7e430643 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:21.699126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e628-8f88-4478-9aaf-c47a7e430643 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:21.699411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e628-8f88-4478-9aaf-c47a7e430643 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:21.700188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e628-8f88-4478-9aaf-c47a7e430643 admin admin] RBAC: Adding query filter params (role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=d2644bd7de5142199f3ef0d06b013971, user.id=310cb95eeed3469b9dee9e716d096b7b) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:21.700492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e628-8f88-4478-9aaf-c47a7e430643 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:21.702336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e628-8f88-4478-9aaf-c47a7e430643 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:21.707763 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 34/68] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:21 2021] GET /identity/v3/role_assignments?user.id=310cb95eeed3469b9dee9e716d096b7b&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=0b0b301f8db844b1903d147750c7e79c => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:23.751973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee441-7637-4203-9727-6cdc28c9b93e None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:23.752491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee441-7637-4203-9727-6cdc28c9b93e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:23.752576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee441-7637-4203-9727-6cdc28c9b93e None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:23.754738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 35/69] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:23.759845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200edd-5e6b-4221-bdec-1d1cb73f80c0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:23.760272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200edd-5e6b-4221-bdec-1d1cb73f80c0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:23.760419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200edd-5e6b-4221-bdec-1d1cb73f80c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:23.782655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-19200edd-5e6b-4221-bdec-1d1cb73f80c0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:23.783797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-19200edd-5e6b-4221-bdec-1d1cb73f80c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:23.792461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 35/70] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:39:23.817947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee441-7637-4203-9727-6cdc28c9b93e None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:23.830113 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee441-7637-4203-9727-6cdc28c9b93e None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:23.835585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045f27a-ff71-4b16-b6ad-9302e16546f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:23.836309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f27a-ff71-4b16-b6ad-9302e16546f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:23.836873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f27a-ff71-4b16-b6ad-9302e16546f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:23.837163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f27a-ff71-4b16-b6ad-9302e16546f4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:23.848293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045f27a-ff71-4b16-b6ad-9302e16546f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:23.855002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-c045f27a-ff71-4b16-b6ad-9302e16546f4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:23.856187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 36/71] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:23.862592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19200edd-5e6b-4221-bdec-1d1cb73f80c0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:23.871886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19200edd-5e6b-4221-bdec-1d1cb73f80c0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:23.876133 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:23.876755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:23.877047 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:23.877333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:23.878075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:23.878380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:23.880536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:23.889909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 36/72] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:23.896106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045f27a-ff71-4b16-b6ad-9302e16546f4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:23.908811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045f27a-ff71-4b16-b6ad-9302e16546f4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:23.913440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e6ca9-23e1-4fd7-9283-a705a3ae6b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:23.914241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6ca9-23e1-4fd7-9283-a705a3ae6b85 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:23.914575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6ca9-23e1-4fd7-9283-a705a3ae6b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:23.914864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6ca9-23e1-4fd7-9283-a705a3ae6b85 admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:23.915996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e6ca9-23e1-4fd7-9283-a705a3ae6b85 admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:23.918192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e6ca9-23e1-4fd7-9283-a705a3ae6b85 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:23.919730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 37/73] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:23 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:23.925321 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:23.934807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a1d1e-0f10-44a5-92a4-dc60a8eeb79b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:23.938862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d97ff9-61a3-4d42-a832-4817535e50af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:23.939653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97ff9-61a3-4d42-a832-4817535e50af admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:23.939944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97ff9-61a3-4d42-a832-4817535e50af admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:23.940229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97ff9-61a3-4d42-a832-4817535e50af admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:23.941852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97ff9-61a3-4d42-a832-4817535e50af admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:23.943929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97ff9-61a3-4d42-a832-4817535e50af admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:23.945473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 37/74] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:23 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:23.951155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e6ca9-23e1-4fd7-9283-a705a3ae6b85 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:23.961182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e6ca9-23e1-4fd7-9283-a705a3ae6b85 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:23.965234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc7aac-4439-4039-a208-3dd11a5df0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:23.966048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc7aac-4439-4039-a208-3dd11a5df0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:23.966336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc7aac-4439-4039-a208-3dd11a5df0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:23.966648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc7aac-4439-4039-a208-3dd11a5df0f3 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971/users/310cb95eeed3469b9dee9e716d096b7b/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:23.968411 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc7aac-4439-4039-a208-3dd11a5df0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2644bd7de5142199f3ef0d06b013971, user_id=310cb95eeed3469b9dee9e716d096b7b, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:23.971118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc7aac-4439-4039-a208-3dd11a5df0f3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:23.983542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 38/75] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:39:23 2021] PUT /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971/users/310cb95eeed3469b9dee9e716d096b7b/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:39:26.056778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf69b5-dd86-4ac2-bfec-e9fd7f5bba42 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:26.057316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf69b5-dd86-4ac2-bfec-e9fd7f5bba42 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:26.057316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf69b5-dd86-4ac2-bfec-e9fd7f5bba42 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:26.059056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 38/76] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:26.064229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dec1d-88ee-4f2e-ace0-2f1890f0ed29 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:26.064621 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dec1d-88ee-4f2e-ace0-2f1890f0ed29 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:26.064809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dec1d-88ee-4f2e-ace0-2f1890f0ed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:26.086344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c27dec1d-88ee-4f2e-ace0-2f1890f0ed29 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:26.087460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c27dec1d-88ee-4f2e-ace0-2f1890f0ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:26.159182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 39/77] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:26.183250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf69b5-dd86-4ac2-bfec-e9fd7f5bba42 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:26.195667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf69b5-dd86-4ac2-bfec-e9fd7f5bba42 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:26.199652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b8cca-6a50-4003-acd6-2b2967b9c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:26.200370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8cca-6a50-4003-acd6-2b2967b9c925 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:26.200664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8cca-6a50-4003-acd6-2b2967b9c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:26.200949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8cca-6a50-4003-acd6-2b2967b9c925 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:26.212408 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b8cca-6a50-4003-acd6-2b2967b9c925 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:26.218974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-b97b8cca-6a50-4003-acd6-2b2967b9c925 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:26.220087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 39/78] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:26.226698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dec1d-88ee-4f2e-ace0-2f1890f0ed29 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:26.235669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dec1d-88ee-4f2e-ace0-2f1890f0ed29 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:26.240330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:26.240930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:26.241225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:26.241518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:26.242234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:26.242575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:26.244402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:26.252862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 40/79] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:26.258676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b8cca-6a50-4003-acd6-2b2967b9c925 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:26.268113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b8cca-6a50-4003-acd6-2b2967b9c925 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:26.272141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ee3cb-5207-4a55-882c-dd2f59a1b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:26.272929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee3cb-5207-4a55-882c-dd2f59a1b2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:26.273219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee3cb-5207-4a55-882c-dd2f59a1b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:26.273499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee3cb-5207-4a55-882c-dd2f59a1b2e4 admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:26.274647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ee3cb-5207-4a55-882c-dd2f59a1b2e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:26.276789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ee3cb-5207-4a55-882c-dd2f59a1b2e4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:26.278267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 40/80] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:26 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:26.283906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:26.293933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd632e-f707-478a-881b-5605c326be75 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:26.297970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6d39-2d6f-431a-b91a-ba8cfce1f283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:26.298591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6d39-2d6f-431a-b91a-ba8cfce1f283 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:26.298887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6d39-2d6f-431a-b91a-ba8cfce1f283 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:26.299173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6d39-2d6f-431a-b91a-ba8cfce1f283 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:26.307606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b6d39-2d6f-431a-b91a-ba8cfce1f283 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:26.309397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b6d39-2d6f-431a-b91a-ba8cfce1f283 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:26.317903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 41/81] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:39:26.323729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ee3cb-5207-4a55-882c-dd2f59a1b2e4 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:26.333028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ee3cb-5207-4a55-882c-dd2f59a1b2e4 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:26.337259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d121e-98ac-4487-90f2-a5160ac624ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:26.337969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d121e-98ac-4487-90f2-a5160ac624ec admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:26.338263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d121e-98ac-4487-90f2-a5160ac624ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:26.338594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d121e-98ac-4487-90f2-a5160ac624ec admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:26.339706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d121e-98ac-4487-90f2-a5160ac624ec admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:26.341804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d121e-98ac-4487-90f2-a5160ac624ec admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:26.343366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 41/82] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:26 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:26.350055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6d39-2d6f-431a-b91a-ba8cfce1f283 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:26.366836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6d39-2d6f-431a-b91a-ba8cfce1f283 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:26.370898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687eaef-881b-4b1f-b4e7-b246a8a3fa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:26.371482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687eaef-881b-4b1f-b4e7-b246a8a3fa58 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:26.371770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687eaef-881b-4b1f-b4e7-b246a8a3fa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:26.372049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687eaef-881b-4b1f-b4e7-b246a8a3fa58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:26.372825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687eaef-881b-4b1f-b4e7-b246a8a3fa58 admin admin] RBAC: Adding query filter params (role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=d2644bd7de5142199f3ef0d06b013971, user.id=310cb95eeed3469b9dee9e716d096b7b) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:26.373126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687eaef-881b-4b1f-b4e7-b246a8a3fa58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:26.374123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-e687eaef-881b-4b1f-b4e7-b246a8a3fa58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:39:26.374123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:39:26.374123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:39:26.375319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687eaef-881b-4b1f-b4e7-b246a8a3fa58 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:26.381344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 42/83] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:26 2021] GET /identity/v3/role_assignments?user.id=310cb95eeed3469b9dee9e716d096b7b&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=0b0b301f8db844b1903d147750c7e79c => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:28.605203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a01c-1926-4389-8ec9-9b9585030d3b None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:28.605720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a01c-1926-4389-8ec9-9b9585030d3b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:28.605802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a01c-1926-4389-8ec9-9b9585030d3b None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:28.607465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 42/84] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:28.613562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3d87-1a68-43c3-86be-a0b01705a6a9 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:28.613964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3d87-1a68-43c3-86be-a0b01705a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:28.614127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3d87-1a68-43c3-86be-a0b01705a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:28.635925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-780d3d87-1a68-43c3-86be-a0b01705a6a9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:28.637089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-780d3d87-1a68-43c3-86be-a0b01705a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:28.644578 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 43/85] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:39:28.668187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7a01c-1926-4389-8ec9-9b9585030d3b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:28.680367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7a01c-1926-4389-8ec9-9b9585030d3b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:28.684502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d1953-7620-4011-b6fb-73efa1a35efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:28.685253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d1953-7620-4011-b6fb-73efa1a35efe admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:28.685548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d1953-7620-4011-b6fb-73efa1a35efe admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:28.685832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d1953-7620-4011-b6fb-73efa1a35efe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:28.699030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d1953-7620-4011-b6fb-73efa1a35efe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:28.705637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-180d1953-7620-4011-b6fb-73efa1a35efe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:39:28.707331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 43/86] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:39:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:28.713203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3d87-1a68-43c3-86be-a0b01705a6a9 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:28.721896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3d87-1a68-43c3-86be-a0b01705a6a9 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:28.726490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:28.727090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:28.727379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:28.727662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:28.728374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:28.728676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:28.730302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:28.739209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 44/87] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:28.746073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d1953-7620-4011-b6fb-73efa1a35efe admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:28.755519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d1953-7620-4011-b6fb-73efa1a35efe admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:28.759873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378f200-fb53-473c-9131-59619d50a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:28.760765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378f200-fb53-473c-9131-59619d50a620 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:28.761059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378f200-fb53-473c-9131-59619d50a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:28.761344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378f200-fb53-473c-9131-59619d50a620 admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:28.762485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378f200-fb53-473c-9131-59619d50a620 admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:28.764305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378f200-fb53-473c-9131-59619d50a620 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:28.765769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 44/88] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:28 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:28.771784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:28.781151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a84744-39eb-4c05-b4df-89e28c3dd2cb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:28.785957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf54e7a-87cd-42a8-8d93-b7955dee538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:28.786622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54e7a-87cd-42a8-8d93-b7955dee538e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:28.786916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54e7a-87cd-42a8-8d93-b7955dee538e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:28.787202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54e7a-87cd-42a8-8d93-b7955dee538e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:28.795329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf54e7a-87cd-42a8-8d93-b7955dee538e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:28.797121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf54e7a-87cd-42a8-8d93-b7955dee538e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:28.805710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 45/89] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:39:28.811519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378f200-fb53-473c-9131-59619d50a620 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:28.821055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378f200-fb53-473c-9131-59619d50a620 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:28.825249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90779e-f53f-4d6f-9c90-241dd587b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:28.826043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90779e-f53f-4d6f-9c90-241dd587b786 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:28.826363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90779e-f53f-4d6f-9c90-241dd587b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:28.826657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90779e-f53f-4d6f-9c90-241dd587b786 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:28.827769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90779e-f53f-4d6f-9c90-241dd587b786 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:28.829826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90779e-f53f-4d6f-9c90-241dd587b786 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:28.831409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 45/90] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:28 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:28.838204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf54e7a-87cd-42a8-8d93-b7955dee538e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:28.847126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf54e7a-87cd-42a8-8d93-b7955dee538e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:28.851926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1b3a-7b2d-4611-ad69-fdbad2664d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:28.852532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1b3a-7b2d-4611-ad69-fdbad2664d44 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:28.852824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1b3a-7b2d-4611-ad69-fdbad2664d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:28.853101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1b3a-7b2d-4611-ad69-fdbad2664d44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:28.853866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e1b3a-7b2d-4611-ad69-fdbad2664d44 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=d2644bd7de5142199f3ef0d06b013971, user.id=c3aab5572b2c402b81621b54bfffba2e) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:28.854171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e1b3a-7b2d-4611-ad69-fdbad2664d44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:28.856130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e1b3a-7b2d-4611-ad69-fdbad2664d44 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:28.861902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 46/91] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:28 2021] GET /identity/v3/role_assignments?user.id=c3aab5572b2c402b81621b54bfffba2e&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=98f77a1006404111a8be8686551c8675 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:30.922045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f88ee-489a-4626-a395-0e20c878ddee None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:30.922590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f88ee-489a-4626-a395-0e20c878ddee None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:30.922672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f88ee-489a-4626-a395-0e20c878ddee None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:30.924297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 46/92] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:30.930039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d8dad-00d0-4c33-bbdb-e3c23ac46fae None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:30.930464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d8dad-00d0-4c33-bbdb-e3c23ac46fae None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:30.930662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d8dad-00d0-4c33-bbdb-e3c23ac46fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:30.955229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7f0d8dad-00d0-4c33-bbdb-e3c23ac46fae None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:30.956389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7f0d8dad-00d0-4c33-bbdb-e3c23ac46fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:30.963276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 47/93] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:39:30.985838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f88ee-489a-4626-a395-0e20c878ddee None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:30.998913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f88ee-489a-4626-a395-0e20c878ddee None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:31.003118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac245bb-2d72-4343-b272-d5d29b287ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:31.004527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac245bb-2d72-4343-b272-d5d29b287ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:31.004821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac245bb-2d72-4343-b272-d5d29b287ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:31.005106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac245bb-2d72-4343-b272-d5d29b287ba1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:31.017685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac245bb-2d72-4343-b272-d5d29b287ba1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:31.024349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-6ac245bb-2d72-4343-b272-d5d29b287ba1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:39:31.025510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 47/94] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:39:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:31.031739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d8dad-00d0-4c33-bbdb-e3c23ac46fae None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:31.040838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d8dad-00d0-4c33-bbdb-e3c23ac46fae None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:31.044878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:31.045483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:31.045777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:31.046062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:31.046872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:31.047121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:31.048750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:31.057918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 48/95] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:31.063552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac245bb-2d72-4343-b272-d5d29b287ba1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:31.074123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac245bb-2d72-4343-b272-d5d29b287ba1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:31.078199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9e19-a2aa-4f2d-a256-cd692d7a34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:31.079030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9e19-a2aa-4f2d-a256-cd692d7a34c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:31.079326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9e19-a2aa-4f2d-a256-cd692d7a34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:31.079614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9e19-a2aa-4f2d-a256-cd692d7a34c9 admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:31.080719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d9e19-a2aa-4f2d-a256-cd692d7a34c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:31.082566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d9e19-a2aa-4f2d-a256-cd692d7a34c9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:31.084024 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 48/96] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:31 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:31.089411 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:31.098991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa019cd-f3a5-4aac-973c-6fb6cc9a3944 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:31.104454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95bb40-9942-4490-9c84-e7cf79a8976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:31.105809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95bb40-9942-4490-9c84-e7cf79a8976b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:31.106344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95bb40-9942-4490-9c84-e7cf79a8976b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:31.106777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95bb40-9942-4490-9c84-e7cf79a8976b admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:31.107868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95bb40-9942-4490-9c84-e7cf79a8976b admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:31.110251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95bb40-9942-4490-9c84-e7cf79a8976b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:31.111865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 49/97] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:31 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:31.119200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9e19-a2aa-4f2d-a256-cd692d7a34c9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:31.129314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9e19-a2aa-4f2d-a256-cd692d7a34c9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:31.133405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778ddbd-55e6-4d2d-a5b8-f768304a69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:31.134217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778ddbd-55e6-4d2d-a5b8-f768304a69bd admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:31.134549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778ddbd-55e6-4d2d-a5b8-f768304a69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:31.134841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778ddbd-55e6-4d2d-a5b8-f768304a69bd admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971/users/c3aab5572b2c402b81621b54bfffba2e/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:31.136616 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778ddbd-55e6-4d2d-a5b8-f768304a69bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2644bd7de5142199f3ef0d06b013971, user_id=c3aab5572b2c402b81621b54bfffba2e, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:31.137628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-2778ddbd-55e6-4d2d-a5b8-f768304a69bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:39:31.137628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:39:31.137628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:39:31.139717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778ddbd-55e6-4d2d-a5b8-f768304a69bd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:31.153314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 49/98] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:39:31 2021] PUT /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971/users/c3aab5572b2c402b81621b54bfffba2e/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:39:33.250009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b0de1-c14b-43f2-80a6-470e32cfb579 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:33.250543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b0de1-c14b-43f2-80a6-470e32cfb579 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:33.250543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b0de1-c14b-43f2-80a6-470e32cfb579 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:33.252234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 50/99] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:33.257350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb829bf-caae-4084-87f6-49d8a3e6347d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:33.257742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb829bf-caae-4084-87f6-49d8a3e6347d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:33.257921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb829bf-caae-4084-87f6-49d8a3e6347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:33.280073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-afb829bf-caae-4084-87f6-49d8a3e6347d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:33.281220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-afb829bf-caae-4084-87f6-49d8a3e6347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:33.352559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 50/100] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:33.375548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b0de1-c14b-43f2-80a6-470e32cfb579 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:33.387357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b0de1-c14b-43f2-80a6-470e32cfb579 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:33.391347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e2bdf-9cfc-49ff-9957-5455c3c66be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:33.392069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e2bdf-9cfc-49ff-9957-5455c3c66be0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:33.392360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e2bdf-9cfc-49ff-9957-5455c3c66be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:33.392642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e2bdf-9cfc-49ff-9957-5455c3c66be0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:33.404514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e2bdf-9cfc-49ff-9957-5455c3c66be0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:33.411631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-8a7e2bdf-9cfc-49ff-9957-5455c3c66be0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:39:33.412733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 51/101] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:39:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:39:33.418502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb829bf-caae-4084-87f6-49d8a3e6347d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:33.427223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb829bf-caae-4084-87f6-49d8a3e6347d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:33.431382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:33.431981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:33.432276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:33.432564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:33.433293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:33.433601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:33.435287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:33.443960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 51/102] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:33.449398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e2bdf-9cfc-49ff-9957-5455c3c66be0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:33.459382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e2bdf-9cfc-49ff-9957-5455c3c66be0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:33.463421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342c89a-5231-42f5-8677-4221cc30b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:33.464216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342c89a-5231-42f5-8677-4221cc30b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:33.464510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342c89a-5231-42f5-8677-4221cc30b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:33.464793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342c89a-5231-42f5-8677-4221cc30b4f5 admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:33.465880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342c89a-5231-42f5-8677-4221cc30b4f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:33.467748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342c89a-5231-42f5-8677-4221cc30b4f5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:33.469218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 52/103] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:33 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:33.475288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:33.484957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7489f-25b4-42de-baab-65601b1d369f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:33.489172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10625dc-fb05-493e-9716-71bf0b10e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:33.489758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10625dc-fb05-493e-9716-71bf0b10e651 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:33.490053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10625dc-fb05-493e-9716-71bf0b10e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:33.490340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10625dc-fb05-493e-9716-71bf0b10e651 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:33.498549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10625dc-fb05-493e-9716-71bf0b10e651 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:33.500381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10625dc-fb05-493e-9716-71bf0b10e651 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:33.509384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 52/104] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:39:33.515029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342c89a-5231-42f5-8677-4221cc30b4f5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:33.524975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342c89a-5231-42f5-8677-4221cc30b4f5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:33.529038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199647-28a0-4991-8000-8dfbceff2f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:33.529825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199647-28a0-4991-8000-8dfbceff2f22 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:33.530119 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199647-28a0-4991-8000-8dfbceff2f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:33.530418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199647-28a0-4991-8000-8dfbceff2f22 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:33.531522 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef199647-28a0-4991-8000-8dfbceff2f22 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:33.533581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef199647-28a0-4991-8000-8dfbceff2f22 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:33.535217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 53/105] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:33 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:33.541131 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10625dc-fb05-493e-9716-71bf0b10e651 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:33.549790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10625dc-fb05-493e-9716-71bf0b10e651 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:33.553945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037c671-56fb-4bdc-8b47-8c8a52a97d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:33.554561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c671-56fb-4bdc-8b47-8c8a52a97d70 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:33.554853 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c671-56fb-4bdc-8b47-8c8a52a97d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:33.555137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c671-56fb-4bdc-8b47-8c8a52a97d70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:33.555922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037c671-56fb-4bdc-8b47-8c8a52a97d70 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=d2644bd7de5142199f3ef0d06b013971, user.id=c3aab5572b2c402b81621b54bfffba2e) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:33.556229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037c671-56fb-4bdc-8b47-8c8a52a97d70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:33.558097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037c671-56fb-4bdc-8b47-8c8a52a97d70 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:33.564106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 53/106] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:33 2021] GET /identity/v3/role_assignments?user.id=c3aab5572b2c402b81621b54bfffba2e&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=98f77a1006404111a8be8686551c8675 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:35.764614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e596f-847e-4517-9202-ed0147990d82 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:35.765138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e596f-847e-4517-9202-ed0147990d82 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:35.765221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e596f-847e-4517-9202-ed0147990d82 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:35.766939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 54/107] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:35.772604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87050f-e1a5-48b8-b1cd-a509c836a58a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:35.773003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87050f-e1a5-48b8-b1cd-a509c836a58a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:35.773196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87050f-e1a5-48b8-b1cd-a509c836a58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:35.794576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0a87050f-e1a5-48b8-b1cd-a509c836a58a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:35.795717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0a87050f-e1a5-48b8-b1cd-a509c836a58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:35.802390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 54/108] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:35.825143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e596f-847e-4517-9202-ed0147990d82 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:35.837947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e596f-847e-4517-9202-ed0147990d82 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:35.842117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e7e09-2fb1-40d8-a905-23430c226f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:35.842925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e7e09-2fb1-40d8-a905-23430c226f4b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:35.843222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e7e09-2fb1-40d8-a905-23430c226f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:35.843508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e7e09-2fb1-40d8-a905-23430c226f4b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:35.856328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e7e09-2fb1-40d8-a905-23430c226f4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:35.863719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-b16e7e09-2fb1-40d8-a905-23430c226f4b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:39:35.864918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 55/109] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:39:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:35.870931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87050f-e1a5-48b8-b1cd-a509c836a58a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:35.880145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87050f-e1a5-48b8-b1cd-a509c836a58a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:35.884483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:35.885079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:35.885370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:35.885655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:35.886375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:35.886705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:35.888324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:35.897923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 55/110] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:39:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:35.903352 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e7e09-2fb1-40d8-a905-23430c226f4b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:35.913278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e7e09-2fb1-40d8-a905-23430c226f4b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:35.917383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55c38f-daff-4f72-9a50-5a94cf00d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:35.918184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55c38f-daff-4f72-9a50-5a94cf00d765 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:35.918541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55c38f-daff-4f72-9a50-5a94cf00d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:35.918828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55c38f-daff-4f72-9a50-5a94cf00d765 admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:35.919968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55c38f-daff-4f72-9a50-5a94cf00d765 admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:35.922132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55c38f-daff-4f72-9a50-5a94cf00d765 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:35.923666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 56/111] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:35 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:35.929286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:35.938650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f942af8-661b-4c7b-842d-026d7728274d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:35.943243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b5b92-2506-4ba8-89a7-08353e8521e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:35.943819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b5b92-2506-4ba8-89a7-08353e8521e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:35.944109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b5b92-2506-4ba8-89a7-08353e8521e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:35.944393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b5b92-2506-4ba8-89a7-08353e8521e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:35.952495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b5b92-2506-4ba8-89a7-08353e8521e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:35.954258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b5b92-2506-4ba8-89a7-08353e8521e6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:35.963550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 56/112] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:39:35.969184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55c38f-daff-4f72-9a50-5a94cf00d765 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:35.978653 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55c38f-daff-4f72-9a50-5a94cf00d765 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:35.982761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181a41f-1aac-473c-bcaf-9b8628835d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:35.983542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a41f-1aac-473c-bcaf-9b8628835d45 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:35.984077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a41f-1aac-473c-bcaf-9b8628835d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:35.984365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a41f-1aac-473c-bcaf-9b8628835d45 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:35.985449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181a41f-1aac-473c-bcaf-9b8628835d45 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:35.987611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181a41f-1aac-473c-bcaf-9b8628835d45 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:35.989133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 57/113] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:35 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:35.994867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b5b92-2506-4ba8-89a7-08353e8521e6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:36.004571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b5b92-2506-4ba8-89a7-08353e8521e6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:36.008791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974d820-e4c7-4ea9-90b1-3743bca06430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:36.009369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d820-e4c7-4ea9-90b1-3743bca06430 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:36.009662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d820-e4c7-4ea9-90b1-3743bca06430 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:36.009948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d820-e4c7-4ea9-90b1-3743bca06430 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:36.010782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974d820-e4c7-4ea9-90b1-3743bca06430 admin admin] RBAC: Adding query filter params (role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=d2644bd7de5142199f3ef0d06b013971, user.id=310cb95eeed3469b9dee9e716d096b7b) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:36.011090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974d820-e4c7-4ea9-90b1-3743bca06430 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:36.012965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974d820-e4c7-4ea9-90b1-3743bca06430 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:36.018628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 57/114] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:35 2021] GET /identity/v3/role_assignments?user.id=310cb95eeed3469b9dee9e716d096b7b&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:38.093693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95397-c661-4473-a2a4-44f6ad711663 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:38.094220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95397-c661-4473-a2a4-44f6ad711663 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:38.094220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95397-c661-4473-a2a4-44f6ad711663 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:38.095936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 58/115] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:38.101672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf403-f98c-46a1-82cd-ef38264df6f1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:38.102056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf403-f98c-46a1-82cd-ef38264df6f1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:38.102254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf403-f98c-46a1-82cd-ef38264df6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:38.124599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4a9cf403-f98c-46a1-82cd-ef38264df6f1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:38.125747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4a9cf403-f98c-46a1-82cd-ef38264df6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:38.132621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 58/116] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:38.158497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95397-c661-4473-a2a4-44f6ad711663 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:38.173562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95397-c661-4473-a2a4-44f6ad711663 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:38.178342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6d058-d92a-49f3-8622-50450cf1c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:38.179143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d058-d92a-49f3-8622-50450cf1c86a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:38.179437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d058-d92a-49f3-8622-50450cf1c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:38.179724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d058-d92a-49f3-8622-50450cf1c86a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:38.191805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6d058-d92a-49f3-8622-50450cf1c86a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:38.198739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-4af6d058-d92a-49f3-8622-50450cf1c86a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:39:38.199881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 59/117] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:39:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:38.205749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cf403-f98c-46a1-82cd-ef38264df6f1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:38.214354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cf403-f98c-46a1-82cd-ef38264df6f1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:38.218327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:38.218946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:38.219235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:38.219514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:38.220219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:38.220517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:38.222642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:38.230953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 59/118] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:39:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:38.236935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6d058-d92a-49f3-8622-50450cf1c86a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:38.248417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6d058-d92a-49f3-8622-50450cf1c86a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:38.252481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0c12a-54ed-4936-b855-3c8b0f196d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:38.253277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c12a-54ed-4936-b855-3c8b0f196d4b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:38.253571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c12a-54ed-4936-b855-3c8b0f196d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:38.253859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c12a-54ed-4936-b855-3c8b0f196d4b admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:38.254998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0c12a-54ed-4936-b855-3c8b0f196d4b admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:38.257183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0c12a-54ed-4936-b855-3c8b0f196d4b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:38.258721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 60/119] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:38 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:38.264289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:38.273814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c706d-a554-4101-ba95-908f3822f646 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:38.278010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae92762-2bb5-49d4-9ee5-33fa22c2e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:38.278839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae92762-2bb5-49d4-9ee5-33fa22c2e1dd admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:38.279128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae92762-2bb5-49d4-9ee5-33fa22c2e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:38.279438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae92762-2bb5-49d4-9ee5-33fa22c2e1dd admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:38.280509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae92762-2bb5-49d4-9ee5-33fa22c2e1dd admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:38.282620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae92762-2bb5-49d4-9ee5-33fa22c2e1dd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:38.284142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 60/120] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:38 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:38.290186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0c12a-54ed-4936-b855-3c8b0f196d4b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:38.299588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0c12a-54ed-4936-b855-3c8b0f196d4b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:38.304292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178dca9-9217-4fbc-9a09-d53061355d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:38.305116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178dca9-9217-4fbc-9a09-d53061355d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:38.305406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178dca9-9217-4fbc-9a09-d53061355d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:38.305690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178dca9-9217-4fbc-9a09-d53061355d7a admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971/users/310cb95eeed3469b9dee9e716d096b7b/roles/9aea1c8bef3a4845b02455d1934a3771` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:38.307728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178dca9-9217-4fbc-9a09-d53061355d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2644bd7de5142199f3ef0d06b013971, user_id=310cb95eeed3469b9dee9e716d096b7b, role_id=9aea1c8bef3a4845b02455d1934a3771)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:38.310392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178dca9-9217-4fbc-9a09-d53061355d7a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:38.323113 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 61/121] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:39:38 2021] PUT /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971/users/310cb95eeed3469b9dee9e716d096b7b/roles/9aea1c8bef3a4845b02455d1934a3771 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:39:40.390707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1ba4-0ad3-4c9a-8694-18853a780c47 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:40.391292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1ba4-0ad3-4c9a-8694-18853a780c47 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:40.391292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1ba4-0ad3-4c9a-8694-18853a780c47 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:40.392924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 61/122] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:40.398042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00ba7-46ed-478b-97a6-c1d0b47ab56e None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:40.398496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00ba7-46ed-478b-97a6-c1d0b47ab56e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:40.398645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00ba7-46ed-478b-97a6-c1d0b47ab56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:40.420665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-92d00ba7-46ed-478b-97a6-c1d0b47ab56e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:40.421807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-92d00ba7-46ed-478b-97a6-c1d0b47ab56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:40.488825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 62/123] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:40.511132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe1ba4-0ad3-4c9a-8694-18853a780c47 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:40.522811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe1ba4-0ad3-4c9a-8694-18853a780c47 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:40.526712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e6a0-6461-4bb9-8d17-21a66240f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:40.527440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e6a0-6461-4bb9-8d17-21a66240f481 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:40.527728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e6a0-6461-4bb9-8d17-21a66240f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:40.528008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e6a0-6461-4bb9-8d17-21a66240f481 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:40.540308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924e6a0-6461-4bb9-8d17-21a66240f481 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:40.547105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-6924e6a0-6461-4bb9-8d17-21a66240f481 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:39:40.548215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 62/124] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:39:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:40.554688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d00ba7-46ed-478b-97a6-c1d0b47ab56e None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:40.566089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d00ba7-46ed-478b-97a6-c1d0b47ab56e None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:40.570219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:40.570857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:40.571152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:40.571437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:40.572162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:40.572467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:40.574086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:40.582669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 63/125] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:39:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:40.588248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e6a0-6461-4bb9-8d17-21a66240f481 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:40.598396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e6a0-6461-4bb9-8d17-21a66240f481 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:40.602428 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea198-f750-4d3a-9d39-82913d0c2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:40.603223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea198-f750-4d3a-9d39-82913d0c2fcd admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:40.603513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea198-f750-4d3a-9d39-82913d0c2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:40.603794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea198-f750-4d3a-9d39-82913d0c2fcd admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:40.604901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea198-f750-4d3a-9d39-82913d0c2fcd admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:40.607150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea198-f750-4d3a-9d39-82913d0c2fcd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:40.608612 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 63/126] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:40 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:40.615133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:40.624554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae66f8-9cf4-4364-8574-2af22e4fa985 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:40.628624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90016-cc37-487d-b8e8-cbe55d2246e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:40.629205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90016-cc37-487d-b8e8-cbe55d2246e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:40.629500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90016-cc37-487d-b8e8-cbe55d2246e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:40.629787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90016-cc37-487d-b8e8-cbe55d2246e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:40.637576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e90016-cc37-487d-b8e8-cbe55d2246e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:40.639415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e90016-cc37-487d-b8e8-cbe55d2246e4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:40.648468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 64/127] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:39:40.654121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea198-f750-4d3a-9d39-82913d0c2fcd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:40.664191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea198-f750-4d3a-9d39-82913d0c2fcd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:40.668334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a3032-4217-4136-b0f4-d64871cbaad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:40.669117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3032-4217-4136-b0f4-d64871cbaad9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:40.669409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3032-4217-4136-b0f4-d64871cbaad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:40.669691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3032-4217-4136-b0f4-d64871cbaad9 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:40.670842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a3032-4217-4136-b0f4-d64871cbaad9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:40.672921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a3032-4217-4136-b0f4-d64871cbaad9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:40.674481 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 64/128] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:40 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:40.680354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90016-cc37-487d-b8e8-cbe55d2246e4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:40.688869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90016-cc37-487d-b8e8-cbe55d2246e4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:40.692966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784a13-f170-44d9-b9dd-642d25006c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:40.693546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784a13-f170-44d9-b9dd-642d25006c20 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:40.693837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784a13-f170-44d9-b9dd-642d25006c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:40.694119 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784a13-f170-44d9-b9dd-642d25006c20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:40.694933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784a13-f170-44d9-b9dd-642d25006c20 admin admin] RBAC: Adding query filter params (role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=d2644bd7de5142199f3ef0d06b013971, user.id=310cb95eeed3469b9dee9e716d096b7b) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:40.695234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784a13-f170-44d9-b9dd-642d25006c20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:40.697096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784a13-f170-44d9-b9dd-642d25006c20 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:40.703044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 65/129] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:40 2021] GET /identity/v3/role_assignments?user.id=310cb95eeed3469b9dee9e716d096b7b&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:42.941407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d5c45-82ae-4f03-8134-20b61b818d8b None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:42.941953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d5c45-82ae-4f03-8134-20b61b818d8b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:42.941953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d5c45-82ae-4f03-8134-20b61b818d8b None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:42.943673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 65/130] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:42.948779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10467d2a-2a71-4015-8d48-e572742a5248 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:42.949159 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10467d2a-2a71-4015-8d48-e572742a5248 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:42.949348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10467d2a-2a71-4015-8d48-e572742a5248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:42.970845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-10467d2a-2a71-4015-8d48-e572742a5248 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:42.971967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-10467d2a-2a71-4015-8d48-e572742a5248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:42.978686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 66/131] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:43.002760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d5c45-82ae-4f03-8134-20b61b818d8b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:43.015701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d5c45-82ae-4f03-8134-20b61b818d8b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:43.019911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be576e-d6aa-4dc0-96ee-73f7389bf787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:43.020655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be576e-d6aa-4dc0-96ee-73f7389bf787 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:43.020952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be576e-d6aa-4dc0-96ee-73f7389bf787 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:43.021237 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be576e-d6aa-4dc0-96ee-73f7389bf787 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:43.032961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be576e-d6aa-4dc0-96ee-73f7389bf787 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:43.039601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-29be576e-d6aa-4dc0-96ee-73f7389bf787 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:43.040744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 66/132] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:43.046586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10467d2a-2a71-4015-8d48-e572742a5248 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:43.055752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10467d2a-2a71-4015-8d48-e572742a5248 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:43.059827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:43.060427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:43.060720 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:43.061006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:43.061722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:43.062026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:43.063658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:43.072864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 67/133] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:43.078366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be576e-d6aa-4dc0-96ee-73f7389bf787 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:43.088405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be576e-d6aa-4dc0-96ee-73f7389bf787 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:43.092629 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06d62-957d-450e-a24f-62c67c229ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:43.093415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06d62-957d-450e-a24f-62c67c229ecc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:43.093702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06d62-957d-450e-a24f-62c67c229ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:43.093981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06d62-957d-450e-a24f-62c67c229ecc admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:43.095119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e06d62-957d-450e-a24f-62c67c229ecc admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:43.097261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e06d62-957d-450e-a24f-62c67c229ecc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:43.098798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 67/134] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:43 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:43.104203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:43.114355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813dbcb-2a4a-4829-b546-77fc0ef363e8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:43.118450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbfb61-0074-4528-8b02-f31c727a937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:43.119030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb61-0074-4528-8b02-f31c727a937d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:43.119323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb61-0074-4528-8b02-f31c727a937d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:43.119611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb61-0074-4528-8b02-f31c727a937d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:43.127281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbfb61-0074-4528-8b02-f31c727a937d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:43.129629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbfb61-0074-4528-8b02-f31c727a937d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:43.138120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 68/135] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:39:43.143826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06d62-957d-450e-a24f-62c67c229ecc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:43.154010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06d62-957d-450e-a24f-62c67c229ecc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:43.157987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b5edb-9ae9-437a-95f0-2ad41026f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:43.158795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5edb-9ae9-437a-95f0-2ad41026f395 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:43.159083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5edb-9ae9-437a-95f0-2ad41026f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:43.159392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5edb-9ae9-437a-95f0-2ad41026f395 admin admin] PATH_INFO: `/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:43.160475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b5edb-9ae9-437a-95f0-2ad41026f395 admin admin] RBAC: Authorizing `identity:get_project(project_id=31dfb32762cb4f4d8bd754f4c0e39e2c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:43.162564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b5edb-9ae9-437a-95f0-2ad41026f395 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:43.164099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 68/136] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:43 2021] GET /identity/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:43.170008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbfb61-0074-4528-8b02-f31c727a937d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:43.179520 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbfb61-0074-4528-8b02-f31c727a937d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:43.183724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3f58e-4622-4887-ba93-bef323fab1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:43.184308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f58e-4622-4887-ba93-bef323fab1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:43.184599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f58e-4622-4887-ba93-bef323fab1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:43.184880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f58e-4622-4887-ba93-bef323fab1a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:43.185658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3f58e-4622-4887-ba93-bef323fab1a4 admin admin] RBAC: Adding query filter params (role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=31dfb32762cb4f4d8bd754f4c0e39e2c, user.id=310cb95eeed3469b9dee9e716d096b7b) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:43.185965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3f58e-4622-4887-ba93-bef323fab1a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:43.187866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3f58e-4622-4887-ba93-bef323fab1a4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:43.194164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 69/137] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:43 2021] GET /identity/v3/role_assignments?user.id=310cb95eeed3469b9dee9e716d096b7b&scope.project.id=31dfb32762cb4f4d8bd754f4c0e39e2c&role.id=0b0b301f8db844b1903d147750c7e79c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:45.240844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a34a-5cf7-4502-a2da-4a4e71579b37 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:45.241331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a34a-5cf7-4502-a2da-4a4e71579b37 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:45.241331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a34a-5cf7-4502-a2da-4a4e71579b37 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:45.243025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 69/138] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:45.248194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65757eb5-3f6b-455c-bac1-d607a7272e44 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:45.248619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65757eb5-3f6b-455c-bac1-d607a7272e44 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:45.248764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65757eb5-3f6b-455c-bac1-d607a7272e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:45.270609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-65757eb5-3f6b-455c-bac1-d607a7272e44 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:45.271733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-65757eb5-3f6b-455c-bac1-d607a7272e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:45.278383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 70/139] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:45.300557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675a34a-5cf7-4502-a2da-4a4e71579b37 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:45.312824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675a34a-5cf7-4502-a2da-4a4e71579b37 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:45.316958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0524c-37f7-49ee-890b-68d0059d89c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:45.317714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0524c-37f7-49ee-890b-68d0059d89c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:45.318009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0524c-37f7-49ee-890b-68d0059d89c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:45.318297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0524c-37f7-49ee-890b-68d0059d89c3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:45.331481 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0524c-37f7-49ee-890b-68d0059d89c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:45.338195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-78d0524c-37f7-49ee-890b-68d0059d89c3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:45.339400 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 70/140] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:45 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:45.345377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65757eb5-3f6b-455c-bac1-d607a7272e44 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:45.354684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65757eb5-3f6b-455c-bac1-d607a7272e44 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:45.358806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:45.359658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:45.359948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:45.360257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:45.360972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:45.361274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:45.362914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:45.371501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 71/141] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:45.377053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0524c-37f7-49ee-890b-68d0059d89c3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:45.388395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0524c-37f7-49ee-890b-68d0059d89c3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:45.392433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e34ac1-8452-4669-a0ec-d265aedb4a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:45.393231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e34ac1-8452-4669-a0ec-d265aedb4a9e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:45.394018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e34ac1-8452-4669-a0ec-d265aedb4a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:45.394304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e34ac1-8452-4669-a0ec-d265aedb4a9e admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:45.395458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e34ac1-8452-4669-a0ec-d265aedb4a9e admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:45.397593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e34ac1-8452-4669-a0ec-d265aedb4a9e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:45.399098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 71/142] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:45 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:45.404601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:45.414576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01b914-b304-4ea0-97b7-726ed0332ff1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:45.418523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0e038-e155-444a-a8b5-644905005b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:45.419308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e038-e155-444a-a8b5-644905005b56 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:45.419593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e038-e155-444a-a8b5-644905005b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:45.419869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e038-e155-444a-a8b5-644905005b56 admin admin] PATH_INFO: `/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:45.420949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0e038-e155-444a-a8b5-644905005b56 admin admin] RBAC: Authorizing `identity:get_project(project_id=31dfb32762cb4f4d8bd754f4c0e39e2c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:45.423048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0e038-e155-444a-a8b5-644905005b56 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:45.424572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 72/143] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:45 2021] GET /identity/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:45.430384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e34ac1-8452-4669-a0ec-d265aedb4a9e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:45.439740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e34ac1-8452-4669-a0ec-d265aedb4a9e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:45.443693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5322a09-e3b4-4714-b10b-b4f73f2bd876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:45.444502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322a09-e3b4-4714-b10b-b4f73f2bd876 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:45.444791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322a09-e3b4-4714-b10b-b4f73f2bd876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:45.445076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322a09-e3b4-4714-b10b-b4f73f2bd876 admin admin] PATH_INFO: `/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c/users/310cb95eeed3469b9dee9e716d096b7b/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:45.446872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5322a09-e3b4-4714-b10b-b4f73f2bd876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dfb32762cb4f4d8bd754f4c0e39e2c, user_id=310cb95eeed3469b9dee9e716d096b7b, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:45.449511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5322a09-e3b4-4714-b10b-b4f73f2bd876 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:45.462571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 72/144] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:39:45 2021] PUT /identity/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c/users/310cb95eeed3469b9dee9e716d096b7b/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:39:47.523515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b609cd-959f-4236-ae04-6d351ced4086 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:47.524040 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b609cd-959f-4236-ae04-6d351ced4086 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:47.524153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b609cd-959f-4236-ae04-6d351ced4086 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:47.525761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 73/145] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:47.530919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b4c2-453a-430a-8323-2a76f9da27a9 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:47.531421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b4c2-453a-430a-8323-2a76f9da27a9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:47.531715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b4c2-453a-430a-8323-2a76f9da27a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:47.557316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d957b4c2-453a-430a-8323-2a76f9da27a9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:47.558682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d957b4c2-453a-430a-8323-2a76f9da27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:47.625406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 73/146] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:47.648657 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b609cd-959f-4236-ae04-6d351ced4086 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:47.660477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b609cd-959f-4236-ae04-6d351ced4086 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:47.664459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd21eb3-abae-456e-9887-000ca55b108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:47.665187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21eb3-abae-456e-9887-000ca55b108a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:47.665480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21eb3-abae-456e-9887-000ca55b108a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:47.665766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21eb3-abae-456e-9887-000ca55b108a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:47.677613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd21eb3-abae-456e-9887-000ca55b108a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:47.684149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-fcd21eb3-abae-456e-9887-000ca55b108a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:47.685260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 74/147] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:47.691684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957b4c2-453a-430a-8323-2a76f9da27a9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:47.700435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957b4c2-453a-430a-8323-2a76f9da27a9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:47.704579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:47.705184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:47.705478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:47.705765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:47.706524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:47.706831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:47.708433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:47.716830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 74/148] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:39:47.722211 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd21eb3-abae-456e-9887-000ca55b108a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:47.731529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd21eb3-abae-456e-9887-000ca55b108a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:47.736087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7cf55-654e-4752-bc3f-ce8b8cdf8280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:47.736643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7cf55-654e-4752-bc3f-ce8b8cdf8280 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:47.736929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7cf55-654e-4752-bc3f-ce8b8cdf8280 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:47.737748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7cf55-654e-4752-bc3f-ce8b8cdf8280 admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:47.738886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7cf55-654e-4752-bc3f-ce8b8cdf8280 admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:47.741056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7cf55-654e-4752-bc3f-ce8b8cdf8280 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:47.742553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 75/149] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:47 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:47.750804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:47.760647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85601f3-0d89-4bf4-a1d0-2efe7ba21206 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:47.764673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e45ee-ff24-4d07-8e16-22b30c8694e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:47.765242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e45ee-ff24-4d07-8e16-22b30c8694e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:47.765532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e45ee-ff24-4d07-8e16-22b30c8694e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:47.765815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e45ee-ff24-4d07-8e16-22b30c8694e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:47.773627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e45ee-ff24-4d07-8e16-22b30c8694e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:47.775376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e45ee-ff24-4d07-8e16-22b30c8694e9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:47.784426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 75/150] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:39:47.789954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7cf55-654e-4752-bc3f-ce8b8cdf8280 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:47.799265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7cf55-654e-4752-bc3f-ce8b8cdf8280 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:47.803830 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b06f9-9879-4069-aea5-82e4a8c17a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:47.804612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b06f9-9879-4069-aea5-82e4a8c17a7b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:47.804904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b06f9-9879-4069-aea5-82e4a8c17a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:47.805189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b06f9-9879-4069-aea5-82e4a8c17a7b admin admin] PATH_INFO: `/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:47.806271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b06f9-9879-4069-aea5-82e4a8c17a7b admin admin] RBAC: Authorizing `identity:get_project(project_id=31dfb32762cb4f4d8bd754f4c0e39e2c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:47.808366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b06f9-9879-4069-aea5-82e4a8c17a7b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:47.810072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 76/151] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:47 2021] GET /identity/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:47.815719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e45ee-ff24-4d07-8e16-22b30c8694e9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:47.824593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e45ee-ff24-4d07-8e16-22b30c8694e9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:47.828682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa5088-2ce3-4df5-90a9-50575d8e1284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:47.829272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa5088-2ce3-4df5-90a9-50575d8e1284 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:47.829568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa5088-2ce3-4df5-90a9-50575d8e1284 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:47.829855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa5088-2ce3-4df5-90a9-50575d8e1284 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:47.830671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa5088-2ce3-4df5-90a9-50575d8e1284 admin admin] RBAC: Adding query filter params (role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=31dfb32762cb4f4d8bd754f4c0e39e2c, user.id=310cb95eeed3469b9dee9e716d096b7b) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:47.830982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa5088-2ce3-4df5-90a9-50575d8e1284 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:47.832840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa5088-2ce3-4df5-90a9-50575d8e1284 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:47.838810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 76/152] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:47 2021] GET /identity/v3/role_assignments?user.id=310cb95eeed3469b9dee9e716d096b7b&scope.project.id=31dfb32762cb4f4d8bd754f4c0e39e2c&role.id=0b0b301f8db844b1903d147750c7e79c => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:49.962031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6ece-21ef-48c8-8ffc-18500a2222c2 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:49.962573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6ece-21ef-48c8-8ffc-18500a2222c2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:49.962675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6ece-21ef-48c8-8ffc-18500a2222c2 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:49.964316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 77/153] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:49.969438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5f77-1c98-4fce-a279-d7daebe7c4e8 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:49.969874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5f77-1c98-4fce-a279-d7daebe7c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:49.969999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5f77-1c98-4fce-a279-d7daebe7c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:49.992393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c39a5f77-1c98-4fce-a279-d7daebe7c4e8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:49.993521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c39a5f77-1c98-4fce-a279-d7daebe7c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:50.000283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 77/154] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:50.024065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6ece-21ef-48c8-8ffc-18500a2222c2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:50.036453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6ece-21ef-48c8-8ffc-18500a2222c2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:50.040586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5afe1-d4d1-4b52-99e7-b39c16bb8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:50.041330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5afe1-d4d1-4b52-99e7-b39c16bb8ffc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:50.041623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5afe1-d4d1-4b52-99e7-b39c16bb8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:50.041906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5afe1-d4d1-4b52-99e7-b39c16bb8ffc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:50.043061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5afe1-d4d1-4b52-99e7-b39c16bb8ffc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:50.044818 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5afe1-d4d1-4b52-99e7-b39c16bb8ffc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:50.046367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 78/155] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:39:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:50.052239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5f77-1c98-4fce-a279-d7daebe7c4e8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:50.060982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5f77-1c98-4fce-a279-d7daebe7c4e8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:50.065601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0ad63-d142-4371-aef7-afad841f16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:50.066192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ad63-d142-4371-aef7-afad841f16e1 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:50.066514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ad63-d142-4371-aef7-afad841f16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:50.066795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ad63-d142-4371-aef7-afad841f16e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:50.067456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0ad63-d142-4371-aef7-afad841f16e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:50.069379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0ad63-d142-4371-aef7-afad841f16e1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:50.096166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 78/156] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:39:50 2021] POST /identity/v3/projects => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:39:52.202891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3aff-df70-40e4-aa98-e88a39af44ac None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:52.203396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3aff-df70-40e4-aa98-e88a39af44ac None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:52.203396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3aff-df70-40e4-aa98-e88a39af44ac None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:52.205121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 79/157] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:52.210430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ebf9e-7d9b-4e73-b353-c2e4d10b9fd9 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:52.210863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ebf9e-7d9b-4e73-b353-c2e4d10b9fd9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:52.211013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ebf9e-7d9b-4e73-b353-c2e4d10b9fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:52.234488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-803ebf9e-7d9b-4e73-b353-c2e4d10b9fd9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:52.235637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-803ebf9e-7d9b-4e73-b353-c2e4d10b9fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:52.312116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 79/158] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:52.335622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3aff-df70-40e4-aa98-e88a39af44ac None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:52.348731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3aff-df70-40e4-aa98-e88a39af44ac None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:52.352712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adedb1-db31-40c0-a38e-3065057f8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:52.353423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adedb1-db31-40c0-a38e-3065057f8b63 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:52.353704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adedb1-db31-40c0-a38e-3065057f8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:52.353977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adedb1-db31-40c0-a38e-3065057f8b63 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:52.355050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adedb1-db31-40c0-a38e-3065057f8b63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:52.356728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adedb1-db31-40c0-a38e-3065057f8b63 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:52.358184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 80/159] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:39:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:52.364721 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ebf9e-7d9b-4e73-b353-c2e4d10b9fd9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:52.373404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ebf9e-7d9b-4e73-b353-c2e4d10b9fd9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:52.377565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a40e10-8acf-42e3-b8a0-4d483d165bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:52.378158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a40e10-8acf-42e3-b8a0-4d483d165bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:52.378483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a40e10-8acf-42e3-b8a0-4d483d165bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:52.378769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a40e10-8acf-42e3-b8a0-4d483d165bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:52.379432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a40e10-8acf-42e3-b8a0-4d483d165bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:52.381385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a40e10-8acf-42e3-b8a0-4d483d165bf4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:52.400634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 80/160] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:39:52 2021] POST /identity/v3/users => generated 283 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:39:54.619288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618218-28e7-4d99-a633-cf8b739010a1 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:54.619805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618218-28e7-4d99-a633-cf8b739010a1 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:54.619889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618218-28e7-4d99-a633-cf8b739010a1 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:54.621484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 81/161] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:54.626640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f0072-7557-4b58-a901-1b407b46b562 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:54.627132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f0072-7557-4b58-a901-1b407b46b562 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:54.627222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f0072-7557-4b58-a901-1b407b46b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:54.651190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-370f0072-7557-4b58-a901-1b407b46b562 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:54.652334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-370f0072-7557-4b58-a901-1b407b46b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:54.659758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 81/162] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:39:54.683353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0618218-28e7-4d99-a633-cf8b739010a1 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:54.695852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0618218-28e7-4d99-a633-cf8b739010a1 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:54.699949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2e21-6730-4bc1-a03d-50ff47653b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:54.700698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2e21-6730-4bc1-a03d-50ff47653b7e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:54.700985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2e21-6730-4bc1-a03d-50ff47653b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:54.701263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2e21-6730-4bc1-a03d-50ff47653b7e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:54.713326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2e21-6730-4bc1-a03d-50ff47653b7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:54.719935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-337c2e21-6730-4bc1-a03d-50ff47653b7e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:54.721068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 82/163] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:54.727524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f0072-7557-4b58-a901-1b407b46b562 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:54.736399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f0072-7557-4b58-a901-1b407b46b562 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:54.741035 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:54.741623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:54.741907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:54.742184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:54.743041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:54.743336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:54.744924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:54.753502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 82/164] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:54.759064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2e21-6730-4bc1-a03d-50ff47653b7e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:54.768307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2e21-6730-4bc1-a03d-50ff47653b7e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:54.772262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149603-c3f1-4f0c-80ec-419f0f6471a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:54.773041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149603-c3f1-4f0c-80ec-419f0f6471a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:54.773323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149603-c3f1-4f0c-80ec-419f0f6471a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:54.773594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149603-c3f1-4f0c-80ec-419f0f6471a6 admin admin] PATH_INFO: `/v3/users/de30de5e8c334cc2969552ddec56a508` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:54.793430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea149603-c3f1-4f0c-80ec-419f0f6471a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=de30de5e8c334cc2969552ddec56a508)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:54.796338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea149603-c3f1-4f0c-80ec-419f0f6471a6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:54.798367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 83/165] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:54 2021] GET /identity/v3/users/de30de5e8c334cc2969552ddec56a508 => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:54.804880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:54.814209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22621f-9c31-4a30-aa1b-eb5742716790 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:54.818181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a40d3-7eb5-4b53-89a6-d16a81565094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:54.818783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a40d3-7eb5-4b53-89a6-d16a81565094 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:54.819068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a40d3-7eb5-4b53-89a6-d16a81565094 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:54.819344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a40d3-7eb5-4b53-89a6-d16a81565094 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:54.827597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a40d3-7eb5-4b53-89a6-d16a81565094 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:54.829360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a40d3-7eb5-4b53-89a6-d16a81565094 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:54.838422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 83/166] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:39:54.844069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149603-c3f1-4f0c-80ec-419f0f6471a6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:54.854012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149603-c3f1-4f0c-80ec-419f0f6471a6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:54.858217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a68c4b-85b7-4abe-affd-041ba6d35ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:54.859292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a68c4b-85b7-4abe-affd-041ba6d35ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:54.859582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a68c4b-85b7-4abe-affd-041ba6d35ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:54.859863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a68c4b-85b7-4abe-affd-041ba6d35ab6 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:54.860980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a68c4b-85b7-4abe-affd-041ba6d35ab6 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:54.863631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a68c4b-85b7-4abe-affd-041ba6d35ab6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:54.865175 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 84/167] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:54 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:54.871089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a40d3-7eb5-4b53-89a6-d16a81565094 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:54.879613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a40d3-7eb5-4b53-89a6-d16a81565094 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:54.883646 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d085c-373a-4487-853b-8b53d060d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:54.884212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d085c-373a-4487-853b-8b53d060d330 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:54.884493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d085c-373a-4487-853b-8b53d060d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:54.884769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d085c-373a-4487-853b-8b53d060d330 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:54.885542 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d085c-373a-4487-853b-8b53d060d330 admin admin] RBAC: Adding query filter params (role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17, user.id=de30de5e8c334cc2969552ddec56a508) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:54.885844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d085c-373a-4487-853b-8b53d060d330 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:54.887692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d085c-373a-4487-853b-8b53d060d330 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:54.893584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 84/168] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:54 2021] GET /identity/v3/role_assignments?user.id=de30de5e8c334cc2969552ddec56a508&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=0b0b301f8db844b1903d147750c7e79c => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:56.943226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd36e3-52c5-453d-ad29-2ded8c8cb00a None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:56.943769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd36e3-52c5-453d-ad29-2ded8c8cb00a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:56.943769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd36e3-52c5-453d-ad29-2ded8c8cb00a None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:56.945439 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 85/169] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:56.950719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873bc26-d96c-4877-8d61-310717170a9d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:56.951141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873bc26-d96c-4877-8d61-310717170a9d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:56.951280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873bc26-d96c-4877-8d61-310717170a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:56.973345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7873bc26-d96c-4877-8d61-310717170a9d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:56.974494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7873bc26-d96c-4877-8d61-310717170a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:56.981180 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 85/170] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:57.003662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd36e3-52c5-453d-ad29-2ded8c8cb00a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:57.015788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd36e3-52c5-453d-ad29-2ded8c8cb00a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:57.020563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa666834-60a7-44eb-b684-7a73ddfd7bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:57.021314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa666834-60a7-44eb-b684-7a73ddfd7bce admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:57.021600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa666834-60a7-44eb-b684-7a73ddfd7bce admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:57.021879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa666834-60a7-44eb-b684-7a73ddfd7bce admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:57.034348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa666834-60a7-44eb-b684-7a73ddfd7bce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:57.041024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-fa666834-60a7-44eb-b684-7a73ddfd7bce admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:57.042192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 86/171] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:57.048309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873bc26-d96c-4877-8d61-310717170a9d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:57.057338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873bc26-d96c-4877-8d61-310717170a9d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:57.062584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:57.063177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:57.063466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:57.063750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:57.064462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:57.064761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:57.066901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:57.075641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 86/172] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:57.081696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa666834-60a7-44eb-b684-7a73ddfd7bce admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:57.091456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa666834-60a7-44eb-b684-7a73ddfd7bce admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:57.095427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a7e4-3783-4526-80a6-d6d94a60eded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:57.096211 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a7e4-3783-4526-80a6-d6d94a60eded admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:57.096494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a7e4-3783-4526-80a6-d6d94a60eded admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:57.096770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a7e4-3783-4526-80a6-d6d94a60eded admin admin] PATH_INFO: `/v3/users/de30de5e8c334cc2969552ddec56a508` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:57.097839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748a7e4-3783-4526-80a6-d6d94a60eded admin admin] RBAC: Authorizing `identity:get_user(user_id=de30de5e8c334cc2969552ddec56a508)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:57.099966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748a7e4-3783-4526-80a6-d6d94a60eded admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:57.101408 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 87/173] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:57 2021] GET /identity/v3/users/de30de5e8c334cc2969552ddec56a508 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:57.106987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:57.116624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5ffb8-e97d-45ee-990b-f1ff8da0dc39 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:57.120660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6272a-6660-4a62-872b-4d9cf7d05a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:57.121443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6272a-6660-4a62-872b-4d9cf7d05a29 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:57.121734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6272a-6660-4a62-872b-4d9cf7d05a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:57.122018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6272a-6660-4a62-872b-4d9cf7d05a29 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:57.123130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6272a-6660-4a62-872b-4d9cf7d05a29 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:57.125168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6272a-6660-4a62-872b-4d9cf7d05a29 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:57.126779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 87/174] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:57 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:57.133030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a7e4-3783-4526-80a6-d6d94a60eded admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:57.142365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a7e4-3783-4526-80a6-d6d94a60eded admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:57.147142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b47e0b-dab4-4a30-a966-7340430e21b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:57.147952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b47e0b-dab4-4a30-a966-7340430e21b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:57.148237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b47e0b-dab4-4a30-a966-7340430e21b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:57.148517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b47e0b-dab4-4a30-a966-7340430e21b7 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/users/de30de5e8c334cc2969552ddec56a508/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:57.150278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b47e0b-dab4-4a30-a966-7340430e21b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f9d2579dd34d1e93b70d9b69e00f17, user_id=de30de5e8c334cc2969552ddec56a508, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:57.152933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b47e0b-dab4-4a30-a966-7340430e21b7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:57.165574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 88/175] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:39:57 2021] PUT /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/users/de30de5e8c334cc2969552ddec56a508/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:39:59.229760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83df45-9846-4d5d-b3b0-b38f0029f0d8 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:59.230301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83df45-9846-4d5d-b3b0-b38f0029f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:59.230301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83df45-9846-4d5d-b3b0-b38f0029f0d8 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:59.231929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 88/176] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:39:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:39:59.238038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cda66-53a5-4679-b717-b2133b090079 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:59.238425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cda66-53a5-4679-b717-b2133b090079 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:59.238645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cda66-53a5-4679-b717-b2133b090079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:59.260107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-ed6cda66-53a5-4679-b717-b2133b090079 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:39:59.261249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ed6cda66-53a5-4679-b717-b2133b090079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:39:59.327731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 89/177] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:39:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:39:59.350921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83df45-9846-4d5d-b3b0-b38f0029f0d8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:59.363877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83df45-9846-4d5d-b3b0-b38f0029f0d8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:59.367746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccbc4-dd61-4ab7-9e58-c50372f1a207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:59.368457 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccbc4-dd61-4ab7-9e58-c50372f1a207 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:59.368739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccbc4-dd61-4ab7-9e58-c50372f1a207 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:59.369015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccbc4-dd61-4ab7-9e58-c50372f1a207 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:59.380307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ccbc4-dd61-4ab7-9e58-c50372f1a207 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:39:59.386820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-aa8ccbc4-dd61-4ab7-9e58-c50372f1a207 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:39:59.387918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 89/178] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:39:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:39:59.394198 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cda66-53a5-4679-b717-b2133b090079 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:59.402749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cda66-53a5-4679-b717-b2133b090079 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:59.406722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:59.407306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:59.407590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:59.407864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:59.408605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:59.409399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:59.411018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:59.419322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 90/179] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:39:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:59.424821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccbc4-dd61-4ab7-9e58-c50372f1a207 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:59.434158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccbc4-dd61-4ab7-9e58-c50372f1a207 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:59.438184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe431b-3db2-418a-b1d3-4efb92e20c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:59.439014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe431b-3db2-418a-b1d3-4efb92e20c0c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:59.439294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe431b-3db2-418a-b1d3-4efb92e20c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:59.439573 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe431b-3db2-418a-b1d3-4efb92e20c0c admin admin] PATH_INFO: `/v3/users/de30de5e8c334cc2969552ddec56a508` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:59.440665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe431b-3db2-418a-b1d3-4efb92e20c0c admin admin] RBAC: Authorizing `identity:get_user(user_id=de30de5e8c334cc2969552ddec56a508)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:59.442850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe431b-3db2-418a-b1d3-4efb92e20c0c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:59.444316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 90/180] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:39:59 2021] GET /identity/v3/users/de30de5e8c334cc2969552ddec56a508 => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:59.449728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:59.459405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36214eec-db02-4112-9f15-f35f1aede138 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:59.463289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c494f-ba06-4e03-9334-1a8a7b1ffa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:59.463850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c494f-ba06-4e03-9334-1a8a7b1ffa32 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:59.464132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c494f-ba06-4e03-9334-1a8a7b1ffa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:59.464403 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c494f-ba06-4e03-9334-1a8a7b1ffa32 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:59.472746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c494f-ba06-4e03-9334-1a8a7b1ffa32 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:59.474585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c494f-ba06-4e03-9334-1a8a7b1ffa32 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:59.482947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 91/181] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:39:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:39:59.489396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe431b-3db2-418a-b1d3-4efb92e20c0c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:59.499574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe431b-3db2-418a-b1d3-4efb92e20c0c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:59.503618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977cceb-a206-4b68-9468-30251aa27adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:59.504400 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977cceb-a206-4b68-9468-30251aa27adf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:59.504690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977cceb-a206-4b68-9468-30251aa27adf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:59.504972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977cceb-a206-4b68-9468-30251aa27adf admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:59.506085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977cceb-a206-4b68-9468-30251aa27adf admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:59.513018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977cceb-a206-4b68-9468-30251aa27adf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:59.513018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 91/182] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:39:59 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:39:59.516174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c494f-ba06-4e03-9334-1a8a7b1ffa32 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:39:59.525043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c494f-ba06-4e03-9334-1a8a7b1ffa32 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:39:59.529083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe63fb-7f68-4022-9dc9-b6821687bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:39:59.529655 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe63fb-7f68-4022-9dc9-b6821687bef9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:39:59.529941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe63fb-7f68-4022-9dc9-b6821687bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:39:59.530219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe63fb-7f68-4022-9dc9-b6821687bef9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:39:59.531059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe63fb-7f68-4022-9dc9-b6821687bef9 admin admin] RBAC: Adding query filter params (role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17, user.id=de30de5e8c334cc2969552ddec56a508) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:39:59.531363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe63fb-7f68-4022-9dc9-b6821687bef9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:39:59.533197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe63fb-7f68-4022-9dc9-b6821687bef9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:39:59.539641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 92/183] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:39:59 2021] GET /identity/v3/role_assignments?user.id=de30de5e8c334cc2969552ddec56a508&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=0b0b301f8db844b1903d147750c7e79c => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:01.751095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d528013-0554-49f4-9f4c-a2e92d327082 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:01.751670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d528013-0554-49f4-9f4c-a2e92d327082 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:01.751670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d528013-0554-49f4-9f4c-a2e92d327082 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:01.754002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 92/184] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:01.759248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248ba5-f0ff-4bff-affc-656ade845537 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:01.759640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248ba5-f0ff-4bff-affc-656ade845537 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:01.759818 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248ba5-f0ff-4bff-affc-656ade845537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:01.785374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-9e248ba5-f0ff-4bff-affc-656ade845537 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:01.786568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9e248ba5-f0ff-4bff-affc-656ade845537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:01.794426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 93/185] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:01.818108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d528013-0554-49f4-9f4c-a2e92d327082 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:01.829852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d528013-0554-49f4-9f4c-a2e92d327082 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:01.833743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad39446-73b2-43f0-9250-96ab778903c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:01.834486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad39446-73b2-43f0-9250-96ab778903c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:01.834778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad39446-73b2-43f0-9250-96ab778903c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:01.835058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad39446-73b2-43f0-9250-96ab778903c3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:01.847202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad39446-73b2-43f0-9250-96ab778903c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:01.853867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-aad39446-73b2-43f0-9250-96ab778903c3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:40:01.855118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 93/186] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:40:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:01.861482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e248ba5-f0ff-4bff-affc-656ade845537 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:01.871153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e248ba5-f0ff-4bff-affc-656ade845537 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:01.875322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:01.875935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:01.876226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:01.876508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:01.877835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:01.878137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:01.879801 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:01.890478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 94/187] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:01.896899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad39446-73b2-43f0-9250-96ab778903c3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:01.908607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad39446-73b2-43f0-9250-96ab778903c3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:01.912662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591ae70-ffc4-49e4-9db0-9d3a900d4bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:01.913453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591ae70-ffc4-49e4-9db0-9d3a900d4bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:01.913748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591ae70-ffc4-49e4-9db0-9d3a900d4bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:01.914028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591ae70-ffc4-49e4-9db0-9d3a900d4bc6 admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:01.915156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591ae70-ffc4-49e4-9db0-9d3a900d4bc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:01.916957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591ae70-ffc4-49e4-9db0-9d3a900d4bc6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:01.918469 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 94/188] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:40:01 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:01.924539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:01.933922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3de130-185c-448c-8bda-23072d5bf60d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:01.937863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5f192-768c-4f31-9318-115d75042355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:01.938462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5f192-768c-4f31-9318-115d75042355 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:01.938756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5f192-768c-4f31-9318-115d75042355 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:01.939037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5f192-768c-4f31-9318-115d75042355 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:01.947224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5f192-768c-4f31-9318-115d75042355 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:01.948977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5f192-768c-4f31-9318-115d75042355 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:01.957625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 95/189] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:01.963292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591ae70-ffc4-49e4-9db0-9d3a900d4bc6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:01.972756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591ae70-ffc4-49e4-9db0-9d3a900d4bc6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:01.976739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f2006-9f37-45a6-b22b-4f66c18afd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:01.977517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f2006-9f37-45a6-b22b-4f66c18afd5d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:01.977805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f2006-9f37-45a6-b22b-4f66c18afd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:01.978087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f2006-9f37-45a6-b22b-4f66c18afd5d admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:01.979211 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f2006-9f37-45a6-b22b-4f66c18afd5d admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:01.981242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f2006-9f37-45a6-b22b-4f66c18afd5d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:01.982796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 95/190] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:01 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:01.989321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5f192-768c-4f31-9318-115d75042355 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:01.998029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5f192-768c-4f31-9318-115d75042355 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:02.002849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8da77d-d36c-4a04-8dc4-7c3f591b79e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:02.003280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da77d-d36c-4a04-8dc4-7c3f591b79e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:02.003568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da77d-d36c-4a04-8dc4-7c3f591b79e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:02.003850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da77d-d36c-4a04-8dc4-7c3f591b79e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:02.004623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8da77d-d36c-4a04-8dc4-7c3f591b79e2 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17, user.id=c3aab5572b2c402b81621b54bfffba2e) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:02.004924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8da77d-d36c-4a04-8dc4-7c3f591b79e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:02.006812 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8da77d-d36c-4a04-8dc4-7c3f591b79e2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:02.012248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 96/191] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:40:01 2021] GET /identity/v3/role_assignments?user.id=c3aab5572b2c402b81621b54bfffba2e&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=98f77a1006404111a8be8686551c8675 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:04.065978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b6dd-6b1e-4c0d-8a67-1ca5bec728f1 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:04.066518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b6dd-6b1e-4c0d-8a67-1ca5bec728f1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:04.066620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b6dd-6b1e-4c0d-8a67-1ca5bec728f1 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:04.068205 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 96/192] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:04.073280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0bb14-c8b1-4690-9f00-e937aeb6f641 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:04.073743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0bb14-c8b1-4690-9f00-e937aeb6f641 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:04.073845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0bb14-c8b1-4690-9f00-e937aeb6f641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:04.095713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-61f0bb14-c8b1-4690-9f00-e937aeb6f641 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:04.097447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-61f0bb14-c8b1-4690-9f00-e937aeb6f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:04.104291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 97/193] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:04.126330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64b6dd-6b1e-4c0d-8a67-1ca5bec728f1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:04.137841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64b6dd-6b1e-4c0d-8a67-1ca5bec728f1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:04.141672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447f8b2-9148-4dd2-a947-7536c6209a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:04.142375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447f8b2-9148-4dd2-a947-7536c6209a25 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:04.143191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447f8b2-9148-4dd2-a947-7536c6209a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:04.143476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447f8b2-9148-4dd2-a947-7536c6209a25 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:04.155817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447f8b2-9148-4dd2-a947-7536c6209a25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:04.163027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-b447f8b2-9148-4dd2-a947-7536c6209a25 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:40:04.164212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 97/194] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:40:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:04.170590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0bb14-c8b1-4690-9f00-e937aeb6f641 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:04.179808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0bb14-c8b1-4690-9f00-e937aeb6f641 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:04.183921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:04.184526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:04.184815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:04.185093 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:04.185809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:04.186111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:04.187764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:04.197082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 98/195] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:04.202725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447f8b2-9148-4dd2-a947-7536c6209a25 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:04.213049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447f8b2-9148-4dd2-a947-7536c6209a25 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:04.217037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2862f-db00-40ba-8805-a5a896b92cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:04.217819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2862f-db00-40ba-8805-a5a896b92cac admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:04.218106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2862f-db00-40ba-8805-a5a896b92cac admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:04.218385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2862f-db00-40ba-8805-a5a896b92cac admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:04.219504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2862f-db00-40ba-8805-a5a896b92cac admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:04.221929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2862f-db00-40ba-8805-a5a896b92cac admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:04.223421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 98/196] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:40:04 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:04.228863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:04.239085 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3ca8a-96ea-48a3-bbb2-3fec2b95ebda admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:04.243114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e728c57-7984-4798-889c-e92aad711711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:04.243902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728c57-7984-4798-889c-e92aad711711 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:04.244197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728c57-7984-4798-889c-e92aad711711 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:04.244481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728c57-7984-4798-889c-e92aad711711 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:04.245565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728c57-7984-4798-889c-e92aad711711 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:04.247648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728c57-7984-4798-889c-e92aad711711 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:04.249180 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 99/197] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:04 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:04.255562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2862f-db00-40ba-8805-a5a896b92cac admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:04.264912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2862f-db00-40ba-8805-a5a896b92cac admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:04.269685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734019-4647-4a95-98c5-cb117d387296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:04.270536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734019-4647-4a95-98c5-cb117d387296 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:04.270826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734019-4647-4a95-98c5-cb117d387296 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:04.271106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734019-4647-4a95-98c5-cb117d387296 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/users/c3aab5572b2c402b81621b54bfffba2e/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:04.272904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c734019-4647-4a95-98c5-cb117d387296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f9d2579dd34d1e93b70d9b69e00f17, user_id=c3aab5572b2c402b81621b54bfffba2e, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:04.275556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c734019-4647-4a95-98c5-cb117d387296 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:04.288321 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 99/198] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:40:04 2021] PUT /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/users/c3aab5572b2c402b81621b54bfffba2e/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:40:06.374576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbbf8-55a2-4bba-802f-850a5b19741d None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:06.375121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbbf8-55a2-4bba-802f-850a5b19741d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:06.375121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbbf8-55a2-4bba-802f-850a5b19741d None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:06.376814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 100/199] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:06.382454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5216d7-aab1-4fc0-9f8c-a0b970891727 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:06.382838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5216d7-aab1-4fc0-9f8c-a0b970891727 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:06.383010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5216d7-aab1-4fc0-9f8c-a0b970891727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:06.404302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0c5216d7-aab1-4fc0-9f8c-a0b970891727 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:06.405422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0c5216d7-aab1-4fc0-9f8c-a0b970891727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:06.468688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 100/200] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:40:06.492400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fbbf8-55a2-4bba-802f-850a5b19741d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:06.504786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fbbf8-55a2-4bba-802f-850a5b19741d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:06.508705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c80e8c-cd85-48d9-830e-f57f2330c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:06.509421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80e8c-cd85-48d9-830e-f57f2330c5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:06.509713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80e8c-cd85-48d9-830e-f57f2330c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:06.509993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80e8c-cd85-48d9-830e-f57f2330c5f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:06.521305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c80e8c-cd85-48d9-830e-f57f2330c5f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:06.527742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-f4c80e8c-cd85-48d9-830e-f57f2330c5f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:40:06.528845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 101/201] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:40:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:06.536506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5216d7-aab1-4fc0-9f8c-a0b970891727 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:06.545184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5216d7-aab1-4fc0-9f8c-a0b970891727 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:06.549890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:06.550508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:06.550802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:06.551083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:06.551794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:06.552091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:06.553668 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:06.562272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 101/202] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:06.567796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c80e8c-cd85-48d9-830e-f57f2330c5f2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:06.577107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c80e8c-cd85-48d9-830e-f57f2330c5f2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:06.581218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f23a76-c68f-4595-bc93-f86722088c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:06.582002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23a76-c68f-4595-bc93-f86722088c6f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:06.582291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23a76-c68f-4595-bc93-f86722088c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:06.582609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23a76-c68f-4595-bc93-f86722088c6f admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:06.583714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f23a76-c68f-4595-bc93-f86722088c6f admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:06.585491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f23a76-c68f-4595-bc93-f86722088c6f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:06.586992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 102/203] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:40:06 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:06.592478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:06.602323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e82e-c94d-4457-b2b3-3357b51d324f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:06.606291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0881f-df7a-4b41-b835-7e6ad4a5758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:06.606898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0881f-df7a-4b41-b835-7e6ad4a5758b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:06.607189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0881f-df7a-4b41-b835-7e6ad4a5758b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:06.607475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0881f-df7a-4b41-b835-7e6ad4a5758b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:06.616037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0881f-df7a-4b41-b835-7e6ad4a5758b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:06.617783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0881f-df7a-4b41-b835-7e6ad4a5758b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:06.628030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 102/204] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:40:06.632123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f23a76-c68f-4595-bc93-f86722088c6f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:06.641422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f23a76-c68f-4595-bc93-f86722088c6f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:06.645435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1680a9-c28d-427a-8c46-57395c4906d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:06.646219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1680a9-c28d-427a-8c46-57395c4906d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:06.646549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1680a9-c28d-427a-8c46-57395c4906d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:06.646834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1680a9-c28d-427a-8c46-57395c4906d7 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:06.647944 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1680a9-c28d-427a-8c46-57395c4906d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:06.649978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1680a9-c28d-427a-8c46-57395c4906d7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:06.651564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 103/205] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:06 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:06.657150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0881f-df7a-4b41-b835-7e6ad4a5758b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:06.666336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0881f-df7a-4b41-b835-7e6ad4a5758b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:06.670384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b21fb8-a4ea-47ba-b920-192bef5b2431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:06.670979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21fb8-a4ea-47ba-b920-192bef5b2431 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:06.671272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21fb8-a4ea-47ba-b920-192bef5b2431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:06.671553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21fb8-a4ea-47ba-b920-192bef5b2431 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:06.672332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b21fb8-a4ea-47ba-b920-192bef5b2431 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17, user.id=c3aab5572b2c402b81621b54bfffba2e) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:06.672633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b21fb8-a4ea-47ba-b920-192bef5b2431 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:06.675140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b21fb8-a4ea-47ba-b920-192bef5b2431 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:06.680913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 103/206] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:40:06 2021] GET /identity/v3/role_assignments?user.id=c3aab5572b2c402b81621b54bfffba2e&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=98f77a1006404111a8be8686551c8675 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:08.893391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dbba3-1cba-4833-96fa-a9958ca3e8a2 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:08.893924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dbba3-1cba-4833-96fa-a9958ca3e8a2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:08.893924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dbba3-1cba-4833-96fa-a9958ca3e8a2 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:08.895725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 104/207] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:08.900929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2d85-9e66-4a3b-ae0c-39e3c1b9fa21 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:08.901322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2d85-9e66-4a3b-ae0c-39e3c1b9fa21 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:08.901489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2d85-9e66-4a3b-ae0c-39e3c1b9fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:08.923260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-447d2d85-9e66-4a3b-ae0c-39e3c1b9fa21 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:08.924479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-447d2d85-9e66-4a3b-ae0c-39e3c1b9fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:08.931445 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 104/208] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:08.954892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dbba3-1cba-4833-96fa-a9958ca3e8a2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:08.967615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dbba3-1cba-4833-96fa-a9958ca3e8a2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:08.971803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bceb6-99d1-4b1f-bc7b-2ed0d22bb136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:08.972564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bceb6-99d1-4b1f-bc7b-2ed0d22bb136 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:08.972855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bceb6-99d1-4b1f-bc7b-2ed0d22bb136 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:08.973136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bceb6-99d1-4b1f-bc7b-2ed0d22bb136 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:08.986134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bceb6-99d1-4b1f-bc7b-2ed0d22bb136 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:08.993325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-cb7bceb6-99d1-4b1f-bc7b-2ed0d22bb136 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:08.994530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 105/209] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:09.000557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2d85-9e66-4a3b-ae0c-39e3c1b9fa21 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:09.010067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2d85-9e66-4a3b-ae0c-39e3c1b9fa21 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:09.014135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:09.014765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:09.015052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:09.015336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:09.016044 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:09.016342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:09.018582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:09.027132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 105/210] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:09.032804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bceb6-99d1-4b1f-bc7b-2ed0d22bb136 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:09.042829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bceb6-99d1-4b1f-bc7b-2ed0d22bb136 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:09.046816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae193f5-649a-442e-b4ff-05ffac3fe0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:09.047613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae193f5-649a-442e-b4ff-05ffac3fe0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:09.047900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae193f5-649a-442e-b4ff-05ffac3fe0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:09.048177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae193f5-649a-442e-b4ff-05ffac3fe0e6 admin admin] PATH_INFO: `/v3/users/de30de5e8c334cc2969552ddec56a508` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:09.049279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae193f5-649a-442e-b4ff-05ffac3fe0e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=de30de5e8c334cc2969552ddec56a508)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:09.051432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae193f5-649a-442e-b4ff-05ffac3fe0e6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:09.052896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 106/211] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:40:09 2021] GET /identity/v3/users/de30de5e8c334cc2969552ddec56a508 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:09.058451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:09.068201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fc873-43a1-4d39-bafc-6c9cc644cf4f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:09.072225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e8d58-a6e9-48ea-9a9f-d62a8f91b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:09.072802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e8d58-a6e9-48ea-9a9f-d62a8f91b5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:09.073091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e8d58-a6e9-48ea-9a9f-d62a8f91b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:09.073370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e8d58-a6e9-48ea-9a9f-d62a8f91b5b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:09.081850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e8d58-a6e9-48ea-9a9f-d62a8f91b5b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:09.083562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e8d58-a6e9-48ea-9a9f-d62a8f91b5b7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:09.091923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 106/212] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:09.097680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae193f5-649a-442e-b4ff-05ffac3fe0e6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:09.107106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae193f5-649a-442e-b4ff-05ffac3fe0e6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:09.111399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1bbc1-2079-485d-8111-65e0d5c2962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:09.112177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1bbc1-2079-485d-8111-65e0d5c2962f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:09.112466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1bbc1-2079-485d-8111-65e0d5c2962f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:09.112745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1bbc1-2079-485d-8111-65e0d5c2962f admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:09.113826 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1bbc1-2079-485d-8111-65e0d5c2962f admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:09.115883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1bbc1-2079-485d-8111-65e0d5c2962f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:09.117423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 107/213] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:09 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:09.123344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e8d58-a6e9-48ea-9a9f-d62a8f91b5b7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:09.132475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e8d58-a6e9-48ea-9a9f-d62a8f91b5b7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:09.136552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485c95b-e9dd-4462-b99e-ef81da07909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:09.137129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c95b-e9dd-4462-b99e-ef81da07909d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:09.137416 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c95b-e9dd-4462-b99e-ef81da07909d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:09.137700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c95b-e9dd-4462-b99e-ef81da07909d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:09.138504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c95b-e9dd-4462-b99e-ef81da07909d admin admin] RBAC: Adding query filter params (role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17, user.id=de30de5e8c334cc2969552ddec56a508) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:09.138812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c95b-e9dd-4462-b99e-ef81da07909d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:09.140647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c95b-e9dd-4462-b99e-ef81da07909d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:09.146879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 107/214] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:40:09 2021] GET /identity/v3/role_assignments?user.id=de30de5e8c334cc2969552ddec56a508&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:11.180787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeefcb-0511-4686-b567-2800b9a615b2 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:11.181266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeefcb-0511-4686-b567-2800b9a615b2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:11.181266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeefcb-0511-4686-b567-2800b9a615b2 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:11.182976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 108/215] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:11.187945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f8e6-4a3d-45a8-a2d9-3198c8cfa738 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:11.188372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f8e6-4a3d-45a8-a2d9-3198c8cfa738 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:11.188502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f8e6-4a3d-45a8-a2d9-3198c8cfa738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:11.210966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-dca4f8e6-4a3d-45a8-a2d9-3198c8cfa738 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:11.212085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-dca4f8e6-4a3d-45a8-a2d9-3198c8cfa738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:11.218873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 108/216] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:11.240633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeefcb-0511-4686-b567-2800b9a615b2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:11.252755 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeefcb-0511-4686-b567-2800b9a615b2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:11.256701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb629-18c3-4be3-8523-976e52d76a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:11.257426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb629-18c3-4be3-8523-976e52d76a74 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:11.257713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb629-18c3-4be3-8523-976e52d76a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:11.257993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb629-18c3-4be3-8523-976e52d76a74 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:11.269854 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbb629-18c3-4be3-8523-976e52d76a74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:11.277088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-eddbb629-18c3-4be3-8523-976e52d76a74 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:11.278288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 109/217] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:11.284552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4f8e6-4a3d-45a8-a2d9-3198c8cfa738 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:11.293671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4f8e6-4a3d-45a8-a2d9-3198c8cfa738 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:11.297937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:11.298598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:11.298888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:11.299168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:11.299903 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:11.300202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:11.301813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:11.310855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 109/218] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:11.317091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb629-18c3-4be3-8523-976e52d76a74 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:11.327197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb629-18c3-4be3-8523-976e52d76a74 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:11.331781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b0e6e-01d9-4af7-bccd-146a7b1a9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:11.332572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0e6e-01d9-4af7-bccd-146a7b1a9644 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:11.332864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0e6e-01d9-4af7-bccd-146a7b1a9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:11.333154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0e6e-01d9-4af7-bccd-146a7b1a9644 admin admin] PATH_INFO: `/v3/users/de30de5e8c334cc2969552ddec56a508` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:11.334250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b0e6e-01d9-4af7-bccd-146a7b1a9644 admin admin] RBAC: Authorizing `identity:get_user(user_id=de30de5e8c334cc2969552ddec56a508)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:11.336430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b0e6e-01d9-4af7-bccd-146a7b1a9644 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:11.337918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 110/219] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:40:11 2021] GET /identity/v3/users/de30de5e8c334cc2969552ddec56a508 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:11.343889 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:11.353633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d049440-7b4c-4023-bb6b-9b60e0c1a190 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:11.357681 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2a4e-650e-4f62-a8cd-6a1ee2eff659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:11.358504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2a4e-650e-4f62-a8cd-6a1ee2eff659 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:11.358798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2a4e-650e-4f62-a8cd-6a1ee2eff659 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:11.359332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2a4e-650e-4f62-a8cd-6a1ee2eff659 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:11.360430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c2a4e-650e-4f62-a8cd-6a1ee2eff659 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:11.362517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c2a4e-650e-4f62-a8cd-6a1ee2eff659 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:11.364054 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 110/220] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:11 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:11.369616 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b0e6e-01d9-4af7-bccd-146a7b1a9644 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:11.379463 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b0e6e-01d9-4af7-bccd-146a7b1a9644 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:11.383394 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45ca60-82e6-45fd-bba9-224bc1633dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:11.384197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ca60-82e6-45fd-bba9-224bc1633dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:11.384481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ca60-82e6-45fd-bba9-224bc1633dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:11.384758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ca60-82e6-45fd-bba9-224bc1633dd3 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/users/de30de5e8c334cc2969552ddec56a508/roles/9aea1c8bef3a4845b02455d1934a3771` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:11.386755 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45ca60-82e6-45fd-bba9-224bc1633dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f9d2579dd34d1e93b70d9b69e00f17, user_id=de30de5e8c334cc2969552ddec56a508, role_id=9aea1c8bef3a4845b02455d1934a3771)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:11.389602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45ca60-82e6-45fd-bba9-224bc1633dd3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:11.402280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 111/221] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:40:11 2021] PUT /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/users/de30de5e8c334cc2969552ddec56a508/roles/9aea1c8bef3a4845b02455d1934a3771 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:40:13.450872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30844a-6920-4ace-a587-ff82bf0fa752 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:13.451392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30844a-6920-4ace-a587-ff82bf0fa752 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:13.451392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30844a-6920-4ace-a587-ff82bf0fa752 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:13.453075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 111/222] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:13.458224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8b518-cfef-4422-a2fa-be3453b9c0dd None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:13.458678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8b518-cfef-4422-a2fa-be3453b9c0dd None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:13.458932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8b518-cfef-4422-a2fa-be3453b9c0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:13.480762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7cf8b518-cfef-4422-a2fa-be3453b9c0dd None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:13.481890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7cf8b518-cfef-4422-a2fa-be3453b9c0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:13.544451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 112/223] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:13.567964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30844a-6920-4ace-a587-ff82bf0fa752 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:13.580364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30844a-6920-4ace-a587-ff82bf0fa752 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:13.584483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109838-e49f-4f67-9fcb-66155b3d93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:13.585247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109838-e49f-4f67-9fcb-66155b3d93b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:13.585538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109838-e49f-4f67-9fcb-66155b3d93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:13.585822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109838-e49f-4f67-9fcb-66155b3d93b5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:13.599336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109838-e49f-4f67-9fcb-66155b3d93b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:13.606316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-cf109838-e49f-4f67-9fcb-66155b3d93b5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:13.607489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 112/224] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:13.614395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8b518-cfef-4422-a2fa-be3453b9c0dd None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:13.623120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8b518-cfef-4422-a2fa-be3453b9c0dd None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:13.627222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:13.627815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:13.628101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:13.628380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:13.629095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:13.629394 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:13.631018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:13.639399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 113/225] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:13.645619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109838-e49f-4f67-9fcb-66155b3d93b5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:13.654923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109838-e49f-4f67-9fcb-66155b3d93b5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:13.659461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e99e-7868-41db-baa1-81dec4f5fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:13.660243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e99e-7868-41db-baa1-81dec4f5fa53 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:13.660524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e99e-7868-41db-baa1-81dec4f5fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:13.660796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e99e-7868-41db-baa1-81dec4f5fa53 admin admin] PATH_INFO: `/v3/users/de30de5e8c334cc2969552ddec56a508` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:13.661909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e99e-7868-41db-baa1-81dec4f5fa53 admin admin] RBAC: Authorizing `identity:get_user(user_id=de30de5e8c334cc2969552ddec56a508)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:13.664026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e99e-7868-41db-baa1-81dec4f5fa53 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:13.665460 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 113/226] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:40:13 2021] GET /identity/v3/users/de30de5e8c334cc2969552ddec56a508 => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:13.670814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:13.680085 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d2b4-7ca2-4177-8fcc-ff13d36f7427 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:13.684016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520523b-8f0f-48b4-b00c-a83e9b0a528b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:13.684585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520523b-8f0f-48b4-b00c-a83e9b0a528b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:13.684873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520523b-8f0f-48b4-b00c-a83e9b0a528b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:13.685154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520523b-8f0f-48b4-b00c-a83e9b0a528b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:13.692754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520523b-8f0f-48b4-b00c-a83e9b0a528b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:13.694521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520523b-8f0f-48b4-b00c-a83e9b0a528b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:13.703046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 114/227] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:13.709121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e99e-7868-41db-baa1-81dec4f5fa53 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:13.718648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e99e-7868-41db-baa1-81dec4f5fa53 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:13.723240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c47b09-4959-449b-99d7-5ac963b2e80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:13.724016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47b09-4959-449b-99d7-5ac963b2e80d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:13.724304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47b09-4959-449b-99d7-5ac963b2e80d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:13.724583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47b09-4959-449b-99d7-5ac963b2e80d admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:13.725673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c47b09-4959-449b-99d7-5ac963b2e80d admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:13.727741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c47b09-4959-449b-99d7-5ac963b2e80d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:13.729263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 114/228] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:13 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:13.735222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520523b-8f0f-48b4-b00c-a83e9b0a528b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:13.743838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520523b-8f0f-48b4-b00c-a83e9b0a528b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:13.747892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab7163-3ed5-4acf-97cf-cd18602ed765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:13.748465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7163-3ed5-4acf-97cf-cd18602ed765 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:13.748750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7163-3ed5-4acf-97cf-cd18602ed765 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:13.749026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7163-3ed5-4acf-97cf-cd18602ed765 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:13.749794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab7163-3ed5-4acf-97cf-cd18602ed765 admin admin] RBAC: Adding query filter params (role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17, user.id=de30de5e8c334cc2969552ddec56a508) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:13.750095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab7163-3ed5-4acf-97cf-cd18602ed765 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:13.751966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab7163-3ed5-4acf-97cf-cd18602ed765 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:13.757694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 115/229] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:40:13 2021] GET /identity/v3/role_assignments?user.id=de30de5e8c334cc2969552ddec56a508&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:15.877158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326584a0-7752-4fa1-96ab-9d2f7ed846c8 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:15.877667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326584a0-7752-4fa1-96ab-9d2f7ed846c8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:15.877751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326584a0-7752-4fa1-96ab-9d2f7ed846c8 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:15.879478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 115/230] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:15.884695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc6ca-fa1b-4715-bd3c-81183ccdf663 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:15.885098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc6ca-fa1b-4715-bd3c-81183ccdf663 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:15.885262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc6ca-fa1b-4715-bd3c-81183ccdf663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:15.907048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-6a8bc6ca-fa1b-4715-bd3c-81183ccdf663 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:15.908815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6a8bc6ca-fa1b-4715-bd3c-81183ccdf663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:15.915545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 116/231] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:15.937369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326584a0-7752-4fa1-96ab-9d2f7ed846c8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:15.949354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326584a0-7752-4fa1-96ab-9d2f7ed846c8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:15.953280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592f2c5-d4b0-4ab6-97d4-61b1a5d68eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:15.953993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f2c5-d4b0-4ab6-97d4-61b1a5d68eff admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:15.954283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f2c5-d4b0-4ab6-97d4-61b1a5d68eff admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:15.954593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f2c5-d4b0-4ab6-97d4-61b1a5d68eff admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:15.956183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592f2c5-d4b0-4ab6-97d4-61b1a5d68eff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:15.957871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592f2c5-d4b0-4ab6-97d4-61b1a5d68eff admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:15.960696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 116/232] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:40:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:15.966424 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc6ca-fa1b-4715-bd3c-81183ccdf663 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:15.976176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc6ca-fa1b-4715-bd3c-81183ccdf663 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:15.980464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f52b1-d8ed-4457-a51c-1421b47ab291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:15.981081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f52b1-d8ed-4457-a51c-1421b47ab291 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:15.981368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f52b1-d8ed-4457-a51c-1421b47ab291 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:15.981648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f52b1-d8ed-4457-a51c-1421b47ab291 admin admin] PATH_INFO: `/v3/groups` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:15.982309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f52b1-d8ed-4457-a51c-1421b47ab291 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:15.983374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-3e4f52b1-d8ed-4457-a51c-1421b47ab291 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:40:15.983374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:40:15.983374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:40:15.984840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f52b1-d8ed-4457-a51c-1421b47ab291 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:15.999684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 117/233] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Oct 25 14:40:15 2021] POST /identity/v3/groups => generated 229 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:40:18.089271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151511-5c74-41a6-8896-351ab62db2f6 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:18.089753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151511-5c74-41a6-8896-351ab62db2f6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:18.089753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151511-5c74-41a6-8896-351ab62db2f6 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:18.091439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 117/234] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:18.096499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848784-807e-49e1-b397-c86723bd8936 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:18.096862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848784-807e-49e1-b397-c86723bd8936 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:18.097068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848784-807e-49e1-b397-c86723bd8936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:18.118799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-8e848784-807e-49e1-b397-c86723bd8936 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:18.119946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8e848784-807e-49e1-b397-c86723bd8936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:18.127294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 118/235] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:18.150186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86151511-5c74-41a6-8896-351ab62db2f6 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:18.161868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86151511-5c74-41a6-8896-351ab62db2f6 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:18.165826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3b7fa-6b18-432a-8c0f-42b541c11fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:18.166571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3b7fa-6b18-432a-8c0f-42b541c11fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:18.166863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3b7fa-6b18-432a-8c0f-42b541c11fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:18.167144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3b7fa-6b18-432a-8c0f-42b541c11fb4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:18.168218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3b7fa-6b18-432a-8c0f-42b541c11fb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:18.169887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3b7fa-6b18-432a-8c0f-42b541c11fb4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:18.171352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 118/236] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:40:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:18.177254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e848784-807e-49e1-b397-c86723bd8936 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:18.186475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e848784-807e-49e1-b397-c86723bd8936 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:18.191540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566ae4c-d208-447f-908c-b4acb4bc111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:18.192160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566ae4c-d208-447f-908c-b4acb4bc111f admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:18.192450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566ae4c-d208-447f-908c-b4acb4bc111f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:18.192731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566ae4c-d208-447f-908c-b4acb4bc111f admin admin] PATH_INFO: `/v3/groups` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:18.193380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566ae4c-d208-447f-908c-b4acb4bc111f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:18.195413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566ae4c-d208-447f-908c-b4acb4bc111f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:18.210123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 119/237] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Oct 25 14:40:18 2021] POST /identity/v3/groups => generated 226 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:40:20.409436 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ea7b-3459-46b1-92ce-37c4a0926911 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:20.409960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ea7b-3459-46b1-92ce-37c4a0926911 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:20.410045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ea7b-3459-46b1-92ce-37c4a0926911 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:20.411683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 119/238] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:20.416830 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d5bd-6491-4540-945d-e0f7198667a4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:20.417245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d5bd-6491-4540-945d-e0f7198667a4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:20.417385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d5bd-6491-4540-945d-e0f7198667a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:20.438738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-23a0d5bd-6491-4540-945d-e0f7198667a4 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:20.439850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-23a0d5bd-6491-4540-945d-e0f7198667a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:20.446607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 120/239] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:40:20.469268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ea7b-3459-46b1-92ce-37c4a0926911 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:20.482203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ea7b-3459-46b1-92ce-37c4a0926911 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:20.486624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b6eb4-7c19-4a80-8282-67bf7c23bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:20.487371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b6eb4-7c19-4a80-8282-67bf7c23bf13 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:20.487656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b6eb4-7c19-4a80-8282-67bf7c23bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:20.487932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b6eb4-7c19-4a80-8282-67bf7c23bf13 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:20.501190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b6eb4-7c19-4a80-8282-67bf7c23bf13 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:20.508140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-237b6eb4-7c19-4a80-8282-67bf7c23bf13 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:40:20.509320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 120/240] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:20.515221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0d5bd-6491-4540-945d-e0f7198667a4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:20.524459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0d5bd-6491-4540-945d-e0f7198667a4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:20.528527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:20.529119 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:20.529398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:20.529675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:20.530383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:20.530709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:20.532305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:20.541664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 121/241] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:40:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:20.547233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b6eb4-7c19-4a80-8282-67bf7c23bf13 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:20.556626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b6eb4-7c19-4a80-8282-67bf7c23bf13 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:20.560657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b78e1-df49-4d77-8293-e99a7ffd267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:20.561221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b78e1-df49-4d77-8293-e99a7ffd267c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:20.561508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b78e1-df49-4d77-8293-e99a7ffd267c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:20.561785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b78e1-df49-4d77-8293-e99a7ffd267c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:20.569449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b78e1-df49-4d77-8293-e99a7ffd267c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:20.571215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b78e1-df49-4d77-8293-e99a7ffd267c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:20.580120 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 121/242] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:40:20.585627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:20.594991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767547ff-1509-4d49-b9d2-a34551880df7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:20.599577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaefa3-bb7e-4638-8a9a-2249bdd83fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:20.600351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaefa3-bb7e-4638-8a9a-2249bdd83fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:20.600634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaefa3-bb7e-4638-8a9a-2249bdd83fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:20.600909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaefa3-bb7e-4638-8a9a-2249bdd83fb2 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:20.601970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaefa3-bb7e-4638-8a9a-2249bdd83fb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:20.604022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaefa3-bb7e-4638-8a9a-2249bdd83fb2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:20.605541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 122/243] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:20 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:20.611285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b78e1-df49-4d77-8293-e99a7ffd267c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:20.619952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b78e1-df49-4d77-8293-e99a7ffd267c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:20.624083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca22c85-2b4b-450f-93a9-0fda2d183f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:20.624864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22c85-2b4b-450f-93a9-0fda2d183f85 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:20.625153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22c85-2b4b-450f-93a9-0fda2d183f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:20.625435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22c85-2b4b-450f-93a9-0fda2d183f85 admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:20.630517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca22c85-2b4b-450f-93a9-0fda2d183f85 admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:20.631531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-7ca22c85-2b4b-450f-93a9-0fda2d183f85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:40:20.631531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:40:20.631531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:40:20.632701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca22c85-2b4b-450f-93a9-0fda2d183f85 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:20.634184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 122/244] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:20 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:20.640524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaefa3-bb7e-4638-8a9a-2249bdd83fb2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:20.650480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaefa3-bb7e-4638-8a9a-2249bdd83fb2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:20.654439 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a3c76-3971-4fca-bcae-9c89feb4438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:20.655017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a3c76-3971-4fca-bcae-9c89feb4438a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:20.655299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a3c76-3971-4fca-bcae-9c89feb4438a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:20.655574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a3c76-3971-4fca-bcae-9c89feb4438a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:20.656340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a3c76-3971-4fca-bcae-9c89feb4438a admin admin] RBAC: Adding query filter params (group.id=e482787031664e62b9727f2427134448, role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=d2644bd7de5142199f3ef0d06b013971) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:20.656638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a3c76-3971-4fca-bcae-9c89feb4438a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:20.659139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a3c76-3971-4fca-bcae-9c89feb4438a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:20.664926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 123/245] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:20 2021] GET /identity/v3/role_assignments?group.id=e482787031664e62b9727f2427134448&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=0b0b301f8db844b1903d147750c7e79c => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:22.710705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb462-6ebb-4853-ba07-895c729c76ec None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:22.711227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb462-6ebb-4853-ba07-895c729c76ec None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:22.711227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb462-6ebb-4853-ba07-895c729c76ec None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:22.712890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 123/246] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:22.718112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b575d-2335-4998-aedb-f06611452577 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:22.718578 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b575d-2335-4998-aedb-f06611452577 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:22.718714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b575d-2335-4998-aedb-f06611452577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:22.742339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5c6b575d-2335-4998-aedb-f06611452577 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:22.743512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5c6b575d-2335-4998-aedb-f06611452577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:22.750316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 124/247] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:40:22.772794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fb462-6ebb-4853-ba07-895c729c76ec None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:22.785124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fb462-6ebb-4853-ba07-895c729c76ec None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:22.789060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960919f9-131b-42bf-ade3-df586d686ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:22.789780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960919f9-131b-42bf-ade3-df586d686ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:22.790073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960919f9-131b-42bf-ade3-df586d686ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:22.790350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960919f9-131b-42bf-ade3-df586d686ff5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:22.801911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960919f9-131b-42bf-ade3-df586d686ff5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:22.808852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-960919f9-131b-42bf-ade3-df586d686ff5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:40:22.810068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 124/248] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:22.816157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b575d-2335-4998-aedb-f06611452577 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:22.825587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b575d-2335-4998-aedb-f06611452577 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:22.830276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:22.830935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:22.831222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:22.831500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:22.832225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:22.832521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:22.834136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:22.843239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 125/249] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:40:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:22.849483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960919f9-131b-42bf-ade3-df586d686ff5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:22.859750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960919f9-131b-42bf-ade3-df586d686ff5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:22.863773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace0f31-9f9a-45c5-ad07-9540f14140d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:22.864546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0f31-9f9a-45c5-ad07-9540f14140d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:22.864836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0f31-9f9a-45c5-ad07-9540f14140d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:22.865118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0f31-9f9a-45c5-ad07-9540f14140d0 admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:22.866197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace0f31-9f9a-45c5-ad07-9540f14140d0 admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:22.868112 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace0f31-9f9a-45c5-ad07-9540f14140d0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:22.869578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 125/250] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:22 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:22.876876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:22.886188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4600d-f5df-436a-96f5-f9180f1359a0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:22.890158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35158fa-23ef-4a41-8e79-076b8014ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:22.890976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35158fa-23ef-4a41-8e79-076b8014ea87 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:22.891259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35158fa-23ef-4a41-8e79-076b8014ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:22.891535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35158fa-23ef-4a41-8e79-076b8014ea87 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:22.893125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35158fa-23ef-4a41-8e79-076b8014ea87 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:22.895178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35158fa-23ef-4a41-8e79-076b8014ea87 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:22.896676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 126/251] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:22 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:22.902322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace0f31-9f9a-45c5-ad07-9540f14140d0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:22.912311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace0f31-9f9a-45c5-ad07-9540f14140d0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:22.916339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528c83e-cc70-43db-946b-49e042c18860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:22.917146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528c83e-cc70-43db-946b-49e042c18860 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:22.917461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528c83e-cc70-43db-946b-49e042c18860 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:22.917746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528c83e-cc70-43db-946b-49e042c18860 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971/groups/e482787031664e62b9727f2427134448/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:22.919522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528c83e-cc70-43db-946b-49e042c18860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2644bd7de5142199f3ef0d06b013971, group_id=e482787031664e62b9727f2427134448, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:22.922112 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528c83e-cc70-43db-946b-49e042c18860 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:22.934699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 126/252] 10.222.0.57 () {58 vars in 1463 bytes} [Mon Oct 25 14:40:22 2021] PUT /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971/groups/e482787031664e62b9727f2427134448/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:40:25.000130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d56f6c-d39a-4fd6-ae88-43391fd73c8e None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:25.000681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d56f6c-d39a-4fd6-ae88-43391fd73c8e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:25.000681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d56f6c-d39a-4fd6-ae88-43391fd73c8e None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:25.002892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 127/253] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:25.007871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2639-8eef-4ed3-a2aa-a3f3204a8bd0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:25.008277 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2639-8eef-4ed3-a2aa-a3f3204a8bd0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:25.008431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2639-8eef-4ed3-a2aa-a3f3204a8bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:25.029667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1bcf2639-8eef-4ed3-a2aa-a3f3204a8bd0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:25.030832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1bcf2639-8eef-4ed3-a2aa-a3f3204a8bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:25.093879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 127/254] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:25.117472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d56f6c-d39a-4fd6-ae88-43391fd73c8e None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:25.130373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d56f6c-d39a-4fd6-ae88-43391fd73c8e None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:25.134491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36655135-5e98-410d-8370-a581ca3464da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:25.135235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655135-5e98-410d-8370-a581ca3464da admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:25.135519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655135-5e98-410d-8370-a581ca3464da admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:25.135795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655135-5e98-410d-8370-a581ca3464da admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:25.148276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36655135-5e98-410d-8370-a581ca3464da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:25.154974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-36655135-5e98-410d-8370-a581ca3464da admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:40:25.156107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 128/255] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:25.162234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf2639-8eef-4ed3-a2aa-a3f3204a8bd0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:25.170889 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf2639-8eef-4ed3-a2aa-a3f3204a8bd0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:25.175427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:25.176011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:25.176293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:25.176565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:25.177269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:25.177561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:25.179166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:25.187749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 128/256] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:40:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:25.194086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36655135-5e98-410d-8370-a581ca3464da admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:25.203360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36655135-5e98-410d-8370-a581ca3464da admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:25.207332 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6f56f-fca8-4039-974d-e4b6560ccdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:25.207894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f56f-fca8-4039-974d-e4b6560ccdbc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:25.208178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f56f-fca8-4039-974d-e4b6560ccdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:25.208455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f56f-fca8-4039-974d-e4b6560ccdbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:25.216012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6f56f-fca8-4039-974d-e4b6560ccdbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:25.217737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6f56f-fca8-4039-974d-e4b6560ccdbc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:25.226159 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 129/257] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:25.231836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:25.241926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98b492-ad98-45d1-8fb3-5a1ea1e2367b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:25.245938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54822113-8839-43fb-be30-363cfb994dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:25.246761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54822113-8839-43fb-be30-363cfb994dca admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:25.247051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54822113-8839-43fb-be30-363cfb994dca admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:25.247333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54822113-8839-43fb-be30-363cfb994dca admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:25.248450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54822113-8839-43fb-be30-363cfb994dca admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:25.250514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54822113-8839-43fb-be30-363cfb994dca admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:25.252677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 129/258] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:25 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:25.258174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6f56f-fca8-4039-974d-e4b6560ccdbc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:25.266777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6f56f-fca8-4039-974d-e4b6560ccdbc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:25.270905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f8a2e-b388-4e3c-8da4-21d567e38768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:25.271685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8a2e-b388-4e3c-8da4-21d567e38768 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:25.271974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8a2e-b388-4e3c-8da4-21d567e38768 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:25.272254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8a2e-b388-4e3c-8da4-21d567e38768 admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:25.273321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f8a2e-b388-4e3c-8da4-21d567e38768 admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:25.274329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-2a7f8a2e-b388-4e3c-8da4-21d567e38768 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:40:25.274329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:40:25.274329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:40:25.275533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f8a2e-b388-4e3c-8da4-21d567e38768 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:25.277110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 130/259] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:25 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:25.283425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54822113-8839-43fb-be30-363cfb994dca admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:25.292798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54822113-8839-43fb-be30-363cfb994dca admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:25.296876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad2013-175b-43df-bc41-4abbf34fb2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:25.297443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad2013-175b-43df-bc41-4abbf34fb2be admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:25.297753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad2013-175b-43df-bc41-4abbf34fb2be admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:25.298012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad2013-175b-43df-bc41-4abbf34fb2be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:25.299449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad2013-175b-43df-bc41-4abbf34fb2be admin admin] RBAC: Adding query filter params (group.id=e482787031664e62b9727f2427134448, role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=d2644bd7de5142199f3ef0d06b013971) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:25.299751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad2013-175b-43df-bc41-4abbf34fb2be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:25.301571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad2013-175b-43df-bc41-4abbf34fb2be admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:25.311441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 130/260] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:25 2021] GET /identity/v3/role_assignments?group.id=e482787031664e62b9727f2427134448&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=0b0b301f8db844b1903d147750c7e79c => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:27.504814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10f90a-472d-4a5a-b825-5c8fc5a903ce None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:27.505372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10f90a-472d-4a5a-b825-5c8fc5a903ce None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:27.505372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10f90a-472d-4a5a-b825-5c8fc5a903ce None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:27.507072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 131/261] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:27.512086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc2f14-e82e-4054-b8f8-d39bbc76436a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:27.512494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc2f14-e82e-4054-b8f8-d39bbc76436a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:27.512672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc2f14-e82e-4054-b8f8-d39bbc76436a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:27.534468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d5cc2f14-e82e-4054-b8f8-d39bbc76436a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:27.535631 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d5cc2f14-e82e-4054-b8f8-d39bbc76436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:27.542373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 131/262] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:40:27.565160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10f90a-472d-4a5a-b825-5c8fc5a903ce None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:27.576808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10f90a-472d-4a5a-b825-5c8fc5a903ce None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:27.580766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c799e3-d66f-43c3-9dcd-ebd4e8df8dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:27.581498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c799e3-d66f-43c3-9dcd-ebd4e8df8dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:27.581788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c799e3-d66f-43c3-9dcd-ebd4e8df8dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:27.582067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c799e3-d66f-43c3-9dcd-ebd4e8df8dc0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:27.594328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c799e3-d66f-43c3-9dcd-ebd4e8df8dc0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:27.602098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-81c799e3-d66f-43c3-9dcd-ebd4e8df8dc0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:27.603313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 132/263] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:27.609828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc2f14-e82e-4054-b8f8-d39bbc76436a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:27.619590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc2f14-e82e-4054-b8f8-d39bbc76436a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:27.623656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:27.624257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:27.624543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:27.624824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:27.625543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:27.625842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:27.627467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:27.636235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 132/264] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:27.641927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c799e3-d66f-43c3-9dcd-ebd4e8df8dc0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:27.651975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c799e3-d66f-43c3-9dcd-ebd4e8df8dc0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:27.656117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eb976-624e-4cee-950c-aea48be64da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:27.656695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eb976-624e-4cee-950c-aea48be64da0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:27.656981 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eb976-624e-4cee-950c-aea48be64da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:27.657314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eb976-624e-4cee-950c-aea48be64da0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:27.670292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eb976-624e-4cee-950c-aea48be64da0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:27.672636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eb976-624e-4cee-950c-aea48be64da0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:27.683249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 133/265] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:27.688909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:27.698169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc35a6-4865-4520-9d72-775648290ba9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:27.702097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217803d-321a-41ac-b632-f9480b9ef9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:27.702912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217803d-321a-41ac-b632-f9480b9ef9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:27.703196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217803d-321a-41ac-b632-f9480b9ef9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:27.703467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217803d-321a-41ac-b632-f9480b9ef9d9 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:27.704544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217803d-321a-41ac-b632-f9480b9ef9d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:27.706584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217803d-321a-41ac-b632-f9480b9ef9d9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:27.708101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 133/266] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:27 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:27.713536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eb976-624e-4cee-950c-aea48be64da0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:27.722668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eb976-624e-4cee-950c-aea48be64da0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:27.726646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb19d-1ec6-41f9-afa3-f0cbc3aac43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:27.727416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb19d-1ec6-41f9-afa3-f0cbc3aac43e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:27.727696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb19d-1ec6-41f9-afa3-f0cbc3aac43e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:27.727970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb19d-1ec6-41f9-afa3-f0cbc3aac43e admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:27.729023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eb19d-1ec6-41f9-afa3-f0cbc3aac43e admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:27.730911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eb19d-1ec6-41f9-afa3-f0cbc3aac43e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:27.732340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 134/267] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:27 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:40:27.738877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217803d-321a-41ac-b632-f9480b9ef9d9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:27.748319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217803d-321a-41ac-b632-f9480b9ef9d9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:27.752963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84262d7b-520d-459f-a708-cd7634003534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:27.753539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262d7b-520d-459f-a708-cd7634003534 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:27.753828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262d7b-520d-459f-a708-cd7634003534 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:27.754107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262d7b-520d-459f-a708-cd7634003534 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:27.754985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84262d7b-520d-459f-a708-cd7634003534 admin admin] RBAC: Adding query filter params (group.id=e482787031664e62b9727f2427134448, role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=d2644bd7de5142199f3ef0d06b013971) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:27.755291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84262d7b-520d-459f-a708-cd7634003534 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:27.757037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84262d7b-520d-459f-a708-cd7634003534 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:27.762490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 134/268] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:27 2021] GET /identity/v3/role_assignments?group.id=e482787031664e62b9727f2427134448&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:29.821712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72333f86-9de8-4821-902a-b7ef3f911988 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:29.822278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72333f86-9de8-4821-902a-b7ef3f911988 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:29.822278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72333f86-9de8-4821-902a-b7ef3f911988 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:29.824299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 135/269] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:29.829181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8daa5e-34ca-4a0d-9b30-4b8e18c26eef None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:29.829547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8daa5e-34ca-4a0d-9b30-4b8e18c26eef None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:29.829750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8daa5e-34ca-4a0d-9b30-4b8e18c26eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:29.851969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7c8daa5e-34ca-4a0d-9b30-4b8e18c26eef None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:29.853107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7c8daa5e-34ca-4a0d-9b30-4b8e18c26eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:29.860120 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 135/270] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:29.882571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72333f86-9de8-4821-902a-b7ef3f911988 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:29.894238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72333f86-9de8-4821-902a-b7ef3f911988 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:29.898206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceed03-eacd-4010-b844-07e6465b2498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:29.899075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceed03-eacd-4010-b844-07e6465b2498 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:29.899365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceed03-eacd-4010-b844-07e6465b2498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:29.899692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceed03-eacd-4010-b844-07e6465b2498 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:29.912871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceed03-eacd-4010-b844-07e6465b2498 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:29.920045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-a3ceed03-eacd-4010-b844-07e6465b2498 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:29.921245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 136/271] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:29.927915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8daa5e-34ca-4a0d-9b30-4b8e18c26eef None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:29.936702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8daa5e-34ca-4a0d-9b30-4b8e18c26eef None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:29.940773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:29.941369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:29.941657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:29.941932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:29.942675 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:29.942971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:29.944536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:29.953189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 136/272] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:29.958937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceed03-eacd-4010-b844-07e6465b2498 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:29.968812 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceed03-eacd-4010-b844-07e6465b2498 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:29.973330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2373829-e2db-4b11-b97a-f82ba4a444c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:29.974233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373829-e2db-4b11-b97a-f82ba4a444c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:29.974558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373829-e2db-4b11-b97a-f82ba4a444c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:29.974842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373829-e2db-4b11-b97a-f82ba4a444c6 admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:29.975922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2373829-e2db-4b11-b97a-f82ba4a444c6 admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:29.977816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2373829-e2db-4b11-b97a-f82ba4a444c6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:29.979336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 137/273] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:29 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:29.985071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:29.994896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ecbc9-fcf6-4414-adf8-e963a940d352 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:29.998783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd919d-e77c-4d65-a52d-c4a6769ad6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:29.999906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd919d-e77c-4d65-a52d-c4a6769ad6fb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:30.000252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd919d-e77c-4d65-a52d-c4a6769ad6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:30.000532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd919d-e77c-4d65-a52d-c4a6769ad6fb admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:30.001641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd919d-e77c-4d65-a52d-c4a6769ad6fb admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:30.003699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd919d-e77c-4d65-a52d-c4a6769ad6fb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:30.005215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 137/274] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:29 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:30.010949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2373829-e2db-4b11-b97a-f82ba4a444c6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:30.020764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2373829-e2db-4b11-b97a-f82ba4a444c6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:30.024734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057f09-744a-4daa-8d00-4d4863db6cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:30.025537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057f09-744a-4daa-8d00-4d4863db6cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:30.025823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057f09-744a-4daa-8d00-4d4863db6cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:30.026105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057f09-744a-4daa-8d00-4d4863db6cd1 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971/groups/e482787031664e62b9727f2427134448/roles/9aea1c8bef3a4845b02455d1934a3771` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:30.028103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057f09-744a-4daa-8d00-4d4863db6cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2644bd7de5142199f3ef0d06b013971, group_id=e482787031664e62b9727f2427134448, role_id=9aea1c8bef3a4845b02455d1934a3771)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:30.030745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057f09-744a-4daa-8d00-4d4863db6cd1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:30.044552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 138/275] 10.222.0.57 () {58 vars in 1463 bytes} [Mon Oct 25 14:40:30 2021] PUT /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971/groups/e482787031664e62b9727f2427134448/roles/9aea1c8bef3a4845b02455d1934a3771 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:40:32.100614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb54cd-34cd-4477-9c27-9e3fbac0e292 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:32.101157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb54cd-34cd-4477-9c27-9e3fbac0e292 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:32.101157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb54cd-34cd-4477-9c27-9e3fbac0e292 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:32.102804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 138/276] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:32.107882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e313-e2a5-4127-ae7f-1be9c5f93bc6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:32.108292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e313-e2a5-4127-ae7f-1be9c5f93bc6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:32.108442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e313-e2a5-4127-ae7f-1be9c5f93bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:32.130484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2ac1e313-e2a5-4127-ae7f-1be9c5f93bc6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:32.131604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2ac1e313-e2a5-4127-ae7f-1be9c5f93bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:32.194131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 139/277] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:32.217361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb54cd-34cd-4477-9c27-9e3fbac0e292 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:32.229559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb54cd-34cd-4477-9c27-9e3fbac0e292 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:32.233470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b153e00-aa58-49c9-a59f-4e2afe7553b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:32.234492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b153e00-aa58-49c9-a59f-4e2afe7553b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:32.234781 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b153e00-aa58-49c9-a59f-4e2afe7553b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:32.235065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b153e00-aa58-49c9-a59f-4e2afe7553b8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:32.246772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b153e00-aa58-49c9-a59f-4e2afe7553b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:32.254139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-4b153e00-aa58-49c9-a59f-4e2afe7553b8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:32.255301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 139/278] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:32.261208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1e313-e2a5-4127-ae7f-1be9c5f93bc6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:32.270745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1e313-e2a5-4127-ae7f-1be9c5f93bc6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:32.274813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:32.275413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:32.275703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:32.275986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:32.276701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:32.277000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:32.278620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:32.287149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 140/279] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:32.292733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b153e00-aa58-49c9-a59f-4e2afe7553b8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:32.302003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b153e00-aa58-49c9-a59f-4e2afe7553b8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:32.305940 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaed79f-c9d2-4ea3-91da-4e2ec0b78588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:32.306541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed79f-c9d2-4ea3-91da-4e2ec0b78588 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:32.306831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed79f-c9d2-4ea3-91da-4e2ec0b78588 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:32.307110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed79f-c9d2-4ea3-91da-4e2ec0b78588 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:32.315306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaed79f-c9d2-4ea3-91da-4e2ec0b78588 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:32.317046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaed79f-c9d2-4ea3-91da-4e2ec0b78588 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:32.325545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 140/280] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:32.331761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:32.340907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd24e09-6854-45c9-8af6-04663ea00924 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:32.344863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29655bb-5b72-41bb-9dea-c6a1f7d5effb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:32.345645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29655bb-5b72-41bb-9dea-c6a1f7d5effb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:32.345927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29655bb-5b72-41bb-9dea-c6a1f7d5effb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:32.346204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29655bb-5b72-41bb-9dea-c6a1f7d5effb admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:32.347325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29655bb-5b72-41bb-9dea-c6a1f7d5effb admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:32.349342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29655bb-5b72-41bb-9dea-c6a1f7d5effb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:32.350975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 141/281] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:32 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:32.356476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaed79f-c9d2-4ea3-91da-4e2ec0b78588 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:32.365508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaed79f-c9d2-4ea3-91da-4e2ec0b78588 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:32.369506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316e1f9-f484-4ab8-bd97-aa6b55d3dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:32.370278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e1f9-f484-4ab8-bd97-aa6b55d3dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:32.370672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e1f9-f484-4ab8-bd97-aa6b55d3dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:32.370952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e1f9-f484-4ab8-bd97-aa6b55d3dec6 admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:32.372022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316e1f9-f484-4ab8-bd97-aa6b55d3dec6 admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:32.373875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316e1f9-f484-4ab8-bd97-aa6b55d3dec6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:32.375358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 141/282] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:32 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:32.381531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29655bb-5b72-41bb-9dea-c6a1f7d5effb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:32.390967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29655bb-5b72-41bb-9dea-c6a1f7d5effb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:32.395527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53a6b-2baf-4a72-b3cb-ffa3cb84ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:32.396104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53a6b-2baf-4a72-b3cb-ffa3cb84ea2d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:32.396394 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53a6b-2baf-4a72-b3cb-ffa3cb84ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:32.396680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53a6b-2baf-4a72-b3cb-ffa3cb84ea2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:32.397454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b53a6b-2baf-4a72-b3cb-ffa3cb84ea2d admin admin] RBAC: Adding query filter params (group.id=e482787031664e62b9727f2427134448, role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=d2644bd7de5142199f3ef0d06b013971) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:32.397759 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b53a6b-2baf-4a72-b3cb-ffa3cb84ea2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:32.399624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b53a6b-2baf-4a72-b3cb-ffa3cb84ea2d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:32.405457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 142/283] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:32 2021] GET /identity/v3/role_assignments?group.id=e482787031664e62b9727f2427134448&scope.project.id=d2644bd7de5142199f3ef0d06b013971&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:34.595485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7bc57-957e-4d64-aa0f-41f5c8752d1b None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:34.596078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7bc57-957e-4d64-aa0f-41f5c8752d1b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:34.596078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7bc57-957e-4d64-aa0f-41f5c8752d1b None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:34.597687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 142/284] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:34.602752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b718b2-efec-4e4c-a030-80a44674cdca None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:34.603144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b718b2-efec-4e4c-a030-80a44674cdca None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:34.603323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b718b2-efec-4e4c-a030-80a44674cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:34.625637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a3b718b2-efec-4e4c-a030-80a44674cdca None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:34.626848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a3b718b2-efec-4e4c-a030-80a44674cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:34.633553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 143/285] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:34.656032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7bc57-957e-4d64-aa0f-41f5c8752d1b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:34.668260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7bc57-957e-4d64-aa0f-41f5c8752d1b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:34.672163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662d99-a952-4318-bc3d-0bb47586ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:34.672874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662d99-a952-4318-bc3d-0bb47586ab82 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:34.673161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662d99-a952-4318-bc3d-0bb47586ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:34.673441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662d99-a952-4318-bc3d-0bb47586ab82 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:34.684265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26662d99-a952-4318-bc3d-0bb47586ab82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:34.690730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-26662d99-a952-4318-bc3d-0bb47586ab82 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:40:34.691815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 143/286] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:34.697499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b718b2-efec-4e4c-a030-80a44674cdca None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:34.706678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b718b2-efec-4e4c-a030-80a44674cdca None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:34.710687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:34.711279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:34.711569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:34.711854 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:34.712562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:34.712862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:34.714464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:34.724201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 144/287] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:40:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:34.730062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662d99-a952-4318-bc3d-0bb47586ab82 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:34.740864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662d99-a952-4318-bc3d-0bb47586ab82 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:34.745005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122ab18-37c3-4833-b860-e7808f082f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:34.745592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ab18-37c3-4833-b860-e7808f082f2a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:34.745878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ab18-37c3-4833-b860-e7808f082f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:34.746156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ab18-37c3-4833-b860-e7808f082f2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:34.754886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122ab18-37c3-4833-b860-e7808f082f2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:34.756643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122ab18-37c3-4833-b860-e7808f082f2a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:34.773008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 144/288] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:34.778867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:34.788804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7192daa-84d5-489d-b43c-5e174161ef98 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:34.792744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7255bb-b116-4cfa-8914-26c83fd43360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:34.793518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7255bb-b116-4cfa-8914-26c83fd43360 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:34.793800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7255bb-b116-4cfa-8914-26c83fd43360 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:34.794076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7255bb-b116-4cfa-8914-26c83fd43360 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:34.795172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7255bb-b116-4cfa-8914-26c83fd43360 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:34.797208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7255bb-b116-4cfa-8914-26c83fd43360 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:34.798771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 145/289] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:34 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:34.804609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122ab18-37c3-4833-b860-e7808f082f2a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:34.820284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122ab18-37c3-4833-b860-e7808f082f2a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:34.826838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cc60c-4d5a-4b27-8181-4a8319b4c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:34.828188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc60c-4d5a-4b27-8181-4a8319b4c13e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:34.828693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc60c-4d5a-4b27-8181-4a8319b4c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:34.829765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc60c-4d5a-4b27-8181-4a8319b4c13e admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:34.831630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cc60c-4d5a-4b27-8181-4a8319b4c13e admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:34.835539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cc60c-4d5a-4b27-8181-4a8319b4c13e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:34.838442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 145/290] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:34 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:34.843859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7255bb-b116-4cfa-8914-26c83fd43360 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:34.853852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7255bb-b116-4cfa-8914-26c83fd43360 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:34.857757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9f393-9a4b-4e6b-a351-3a2b26a82974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:34.858321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f393-9a4b-4e6b-a351-3a2b26a82974 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:34.858654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f393-9a4b-4e6b-a351-3a2b26a82974 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:34.859195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f393-9a4b-4e6b-a351-3a2b26a82974 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:34.859959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9f393-9a4b-4e6b-a351-3a2b26a82974 admin admin] RBAC: Adding query filter params (group.id=e482787031664e62b9727f2427134448, role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:34.860253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9f393-9a4b-4e6b-a351-3a2b26a82974 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:34.862075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9f393-9a4b-4e6b-a351-3a2b26a82974 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:34.867357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 146/291] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:34 2021] GET /identity/v3/role_assignments?group.id=e482787031664e62b9727f2427134448&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=0b0b301f8db844b1903d147750c7e79c => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:36.900798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75947-f433-4f98-bfe0-23f846e0e766 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:36.901338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75947-f433-4f98-bfe0-23f846e0e766 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:36.901338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75947-f433-4f98-bfe0-23f846e0e766 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:36.903065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 146/292] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:36.908373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b0e6-f592-419b-833e-65830c10a509 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:36.908814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b0e6-f592-419b-833e-65830c10a509 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:36.908928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b0e6-f592-419b-833e-65830c10a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:36.930910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c386b0e6-f592-419b-833e-65830c10a509 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:36.932054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c386b0e6-f592-419b-833e-65830c10a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:36.939484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 147/293] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:36.961536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a75947-f433-4f98-bfe0-23f846e0e766 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:36.973001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a75947-f433-4f98-bfe0-23f846e0e766 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:36.976804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15a0aa-a781-4f02-a955-2b27845f6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:36.977511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15a0aa-a781-4f02-a955-2b27845f6291 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:36.977796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15a0aa-a781-4f02-a955-2b27845f6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:36.978077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15a0aa-a781-4f02-a955-2b27845f6291 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:36.990132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15a0aa-a781-4f02-a955-2b27845f6291 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:36.996539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-1c15a0aa-a781-4f02-a955-2b27845f6291 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:40:36.997630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 147/294] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:37.003942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386b0e6-f592-419b-833e-65830c10a509 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:37.012555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386b0e6-f592-419b-833e-65830c10a509 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:37.016575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:37.017166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:37.017451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:37.017730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:37.018473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] RBAC: Adding query filter params (name=member) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:37.018775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:37.020351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:37.028739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 148/295] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:40:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:37.034305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15a0aa-a781-4f02-a955-2b27845f6291 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:37.044692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15a0aa-a781-4f02-a955-2b27845f6291 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:37.049394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49a470-e8e4-4042-99f7-755228d85215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:37.050197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a470-e8e4-4042-99f7-755228d85215 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:37.050523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a470-e8e4-4042-99f7-755228d85215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:37.050803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a470-e8e4-4042-99f7-755228d85215 admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:37.051941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49a470-e8e4-4042-99f7-755228d85215 admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:37.053862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49a470-e8e4-4042-99f7-755228d85215 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:37.055460 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 148/296] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:37 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:37.061180 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:37.071500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb952b02-3180-4e85-be45-43fb0dbe015d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:37.075584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef0ef-70b4-4b4b-9f29-5787297cb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:37.076321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef0ef-70b4-4b4b-9f29-5787297cb7ba admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:37.076610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef0ef-70b4-4b4b-9f29-5787297cb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:37.076891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef0ef-70b4-4b4b-9f29-5787297cb7ba admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:37.078000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef0ef-70b4-4b4b-9f29-5787297cb7ba admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:37.080160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef0ef-70b4-4b4b-9f29-5787297cb7ba admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:37.081715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 149/297] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:37 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:37.087406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49a470-e8e4-4042-99f7-755228d85215 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:37.096737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49a470-e8e4-4042-99f7-755228d85215 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:37.100641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ef6c-f9db-4c5f-a6b0-3c244d8eb3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:37.101432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ef6c-f9db-4c5f-a6b0-3c244d8eb3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:37.101716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ef6c-f9db-4c5f-a6b0-3c244d8eb3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:37.101993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ef6c-f9db-4c5f-a6b0-3c244d8eb3bd admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/groups/e482787031664e62b9727f2427134448/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:37.103752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1ef6c-f9db-4c5f-a6b0-3c244d8eb3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f9d2579dd34d1e93b70d9b69e00f17, group_id=e482787031664e62b9727f2427134448, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:37.106317 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1ef6c-f9db-4c5f-a6b0-3c244d8eb3bd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:37.119486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 149/298] 10.222.0.57 () {58 vars in 1463 bytes} [Mon Oct 25 14:40:37 2021] PUT /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/groups/e482787031664e62b9727f2427134448/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:40:39.150513 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218a48-c82b-4858-a259-14e3eda183fb None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:39.151026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218a48-c82b-4858-a259-14e3eda183fb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:39.151026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218a48-c82b-4858-a259-14e3eda183fb None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:39.152767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 150/299] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:39.158410 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87e88-2b26-445a-b7ec-d8530c0d04be None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:39.158817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87e88-2b26-445a-b7ec-d8530c0d04be None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:39.158998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87e88-2b26-445a-b7ec-d8530c0d04be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:39.180459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f0a87e88-2b26-445a-b7ec-d8530c0d04be None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:39.181596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f0a87e88-2b26-445a-b7ec-d8530c0d04be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:39.243840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 150/300] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:39.265925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd218a48-c82b-4858-a259-14e3eda183fb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:39.278019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd218a48-c82b-4858-a259-14e3eda183fb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:39.281991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75af94-ad0d-4c0c-bb73-0434960eb8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:39.283239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75af94-ad0d-4c0c-bb73-0434960eb8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:39.283525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75af94-ad0d-4c0c-bb73-0434960eb8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:39.283802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75af94-ad0d-4c0c-bb73-0434960eb8f2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:39.295014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75af94-ad0d-4c0c-bb73-0434960eb8f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:39.301518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-bc75af94-ad0d-4c0c-bb73-0434960eb8f2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 14:40:39.302637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 151/301] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:39.308354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a87e88-2b26-445a-b7ec-d8530c0d04be None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:39.317055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a87e88-2b26-445a-b7ec-d8530c0d04be None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:39.321322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:39.321937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:39.322221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:39.322540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:39.323267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:39.323562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:39.325173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:39.335164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 151/302] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:40:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:39.341068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75af94-ad0d-4c0c-bb73-0434960eb8f2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:39.351528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75af94-ad0d-4c0c-bb73-0434960eb8f2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:39.355583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df37921-5e7b-40be-baaa-f97fca027649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:39.356167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37921-5e7b-40be-baaa-f97fca027649 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:39.356455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37921-5e7b-40be-baaa-f97fca027649 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:39.356733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37921-5e7b-40be-baaa-f97fca027649 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:39.365386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df37921-5e7b-40be-baaa-f97fca027649 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:39.367191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df37921-5e7b-40be-baaa-f97fca027649 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:39.375790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 152/303] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:39.381539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:39.390984 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6979-0346-4258-b554-f26107ca43c7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:39.395474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a54e2-db44-4d44-9bc3-d0f92baba9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:39.396256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a54e2-db44-4d44-9bc3-d0f92baba9ba admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:39.396543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a54e2-db44-4d44-9bc3-d0f92baba9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:39.396824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a54e2-db44-4d44-9bc3-d0f92baba9ba admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:39.397921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a54e2-db44-4d44-9bc3-d0f92baba9ba admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:39.399994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a54e2-db44-4d44-9bc3-d0f92baba9ba admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:39.401572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 152/304] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:39 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:39.407624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df37921-5e7b-40be-baaa-f97fca027649 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:39.416335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df37921-5e7b-40be-baaa-f97fca027649 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:39.420379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d1b68-d539-4a9a-85df-a051a76da590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:39.421159 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d1b68-d539-4a9a-85df-a051a76da590 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:39.421449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d1b68-d539-4a9a-85df-a051a76da590 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:39.421729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d1b68-d539-4a9a-85df-a051a76da590 admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:39.422905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d1b68-d539-4a9a-85df-a051a76da590 admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:39.424832 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d1b68-d539-4a9a-85df-a051a76da590 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:39.426282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 153/305] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:39 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:39.431792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a54e2-db44-4d44-9bc3-d0f92baba9ba admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:39.441025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a54e2-db44-4d44-9bc3-d0f92baba9ba admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:39.444944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b0769-27c8-41bb-b55b-67c945cbc826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:39.445510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b0769-27c8-41bb-b55b-67c945cbc826 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:39.445802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b0769-27c8-41bb-b55b-67c945cbc826 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:39.446081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b0769-27c8-41bb-b55b-67c945cbc826 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:39.446901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b0769-27c8-41bb-b55b-67c945cbc826 admin admin] RBAC: Adding query filter params (group.id=e482787031664e62b9727f2427134448, role.id=0b0b301f8db844b1903d147750c7e79c, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:39.447206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b0769-27c8-41bb-b55b-67c945cbc826 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:39.449020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b0769-27c8-41bb-b55b-67c945cbc826 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:39.455161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 153/306] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:39 2021] GET /identity/v3/role_assignments?group.id=e482787031664e62b9727f2427134448&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=0b0b301f8db844b1903d147750c7e79c => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:41.607878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc558-38d9-4410-b784-00f8c46f5f77 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:41.608437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc558-38d9-4410-b784-00f8c46f5f77 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:41.608437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc558-38d9-4410-b784-00f8c46f5f77 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:41.610911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 154/307] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:41.616063 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b5faa-41b9-4d65-8bca-34965670234b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:41.616450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b5faa-41b9-4d65-8bca-34965670234b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:41.616621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b5faa-41b9-4d65-8bca-34965670234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:41.638435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-777b5faa-41b9-4d65-8bca-34965670234b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:41.639553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-777b5faa-41b9-4d65-8bca-34965670234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:41.646250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 154/308] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:41.668565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebc558-38d9-4410-b784-00f8c46f5f77 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:41.680628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebc558-38d9-4410-b784-00f8c46f5f77 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:41.684540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0364-fb2c-4e75-aa9b-843b6311f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:41.685262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0364-fb2c-4e75-aa9b-843b6311f55f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:41.685548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0364-fb2c-4e75-aa9b-843b6311f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:41.685826 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0364-fb2c-4e75-aa9b-843b6311f55f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:41.697436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca0364-fb2c-4e75-aa9b-843b6311f55f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:41.704431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-d2ca0364-fb2c-4e75-aa9b-843b6311f55f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:41.705524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 155/309] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:41.711176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b5faa-41b9-4d65-8bca-34965670234b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:41.719655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b5faa-41b9-4d65-8bca-34965670234b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:41.723623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:41.724202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:41.724483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:41.724759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:41.725462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:41.725758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:41.727339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:41.736168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 155/310] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:41.742478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0364-fb2c-4e75-aa9b-843b6311f55f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:41.755806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0364-fb2c-4e75-aa9b-843b6311f55f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:41.759977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fb18b-6e38-4979-b812-eef5cfbd2d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:41.760555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb18b-6e38-4979-b812-eef5cfbd2d0f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:41.760847 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb18b-6e38-4979-b812-eef5cfbd2d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:41.761130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb18b-6e38-4979-b812-eef5cfbd2d0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:41.768946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fb18b-6e38-4979-b812-eef5cfbd2d0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:41.770721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fb18b-6e38-4979-b812-eef5cfbd2d0f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:41.779054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 156/311] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:41.785362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:41.794787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4efef-58cb-49ba-8880-d1979a371078 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:41.799405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307c278-257f-4269-b46a-cd061ecdca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:41.800185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c278-257f-4269-b46a-cd061ecdca33 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:41.800477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c278-257f-4269-b46a-cd061ecdca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:41.800753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c278-257f-4269-b46a-cd061ecdca33 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:41.801837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307c278-257f-4269-b46a-cd061ecdca33 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:41.803881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307c278-257f-4269-b46a-cd061ecdca33 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:41.805406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 156/312] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:41 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:41.810910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fb18b-6e38-4979-b812-eef5cfbd2d0f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:41.820023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fb18b-6e38-4979-b812-eef5cfbd2d0f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:41.824257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb24df0-8328-4c3b-92e1-68c521c11aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:41.825223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24df0-8328-4c3b-92e1-68c521c11aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:41.825352 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24df0-8328-4c3b-92e1-68c521c11aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:41.825634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24df0-8328-4c3b-92e1-68c521c11aa5 admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:41.826828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb24df0-8328-4c3b-92e1-68c521c11aa5 admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:41.828756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb24df0-8328-4c3b-92e1-68c521c11aa5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:41.830322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 157/313] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:41 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:41.836576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307c278-257f-4269-b46a-cd061ecdca33 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:41.846998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307c278-257f-4269-b46a-cd061ecdca33 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:41.851160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a3c80-49f3-4092-b32a-e804e753bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:41.851755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3c80-49f3-4092-b32a-e804e753bdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:41.852046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3c80-49f3-4092-b32a-e804e753bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:41.852327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3c80-49f3-4092-b32a-e804e753bdb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:41.853113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a3c80-49f3-4092-b32a-e804e753bdb1 admin admin] RBAC: Adding query filter params (group.id=e482787031664e62b9727f2427134448, role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:41.853415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a3c80-49f3-4092-b32a-e804e753bdb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:41.855274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a3c80-49f3-4092-b32a-e804e753bdb1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:41.862003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 157/314] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:41 2021] GET /identity/v3/role_assignments?group.id=e482787031664e62b9727f2427134448&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:43.912881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4fdac-0e04-4e4a-bcc6-162d589daa15 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:43.913398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4fdac-0e04-4e4a-bcc6-162d589daa15 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:43.913398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4fdac-0e04-4e4a-bcc6-162d589daa15 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:43.915138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 158/315] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:43.920417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5505310-1b8d-432b-aed6-3b16954a62e6 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:43.920888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5505310-1b8d-432b-aed6-3b16954a62e6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:43.920978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5505310-1b8d-432b-aed6-3b16954a62e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:43.942370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f5505310-1b8d-432b-aed6-3b16954a62e6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:43.943521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f5505310-1b8d-432b-aed6-3b16954a62e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:43.950269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 158/316] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:43.973973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4fdac-0e04-4e4a-bcc6-162d589daa15 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:43.985877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4fdac-0e04-4e4a-bcc6-162d589daa15 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:43.989787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b22873-9448-438a-92a5-eaaa61e0c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:43.990542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b22873-9448-438a-92a5-eaaa61e0c5da admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:43.990831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b22873-9448-438a-92a5-eaaa61e0c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:43.991112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b22873-9448-438a-92a5-eaaa61e0c5da admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:44.002670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b22873-9448-438a-92a5-eaaa61e0c5da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:44.009621 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-c2b22873-9448-438a-92a5-eaaa61e0c5da admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:44.010756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 159/317] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:44.017155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5505310-1b8d-432b-aed6-3b16954a62e6 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:44.025730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5505310-1b8d-432b-aed6-3b16954a62e6 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:44.029723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:44.030308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:44.030627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:44.030907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:44.031613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:44.031908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:44.033485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:44.041571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 159/318] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:44.046949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b22873-9448-438a-92a5-eaaa61e0c5da admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:44.056624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b22873-9448-438a-92a5-eaaa61e0c5da admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:44.060610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95078fbe-48df-4097-b97f-e76ed78d55ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:44.061376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95078fbe-48df-4097-b97f-e76ed78d55ff admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:44.061662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95078fbe-48df-4097-b97f-e76ed78d55ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:44.061941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95078fbe-48df-4097-b97f-e76ed78d55ff admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:44.063533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95078fbe-48df-4097-b97f-e76ed78d55ff admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:44.065413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95078fbe-48df-4097-b97f-e76ed78d55ff admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:44.066915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 160/319] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:44 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:44.072246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:44.082021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e9f2-95cd-4bc5-9a07-1a764a18f3c0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:44.086020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f47eec-1796-4530-953a-89a33ec24876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:44.086828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47eec-1796-4530-953a-89a33ec24876 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:44.087118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47eec-1796-4530-953a-89a33ec24876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:44.087402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47eec-1796-4530-953a-89a33ec24876 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:44.088502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f47eec-1796-4530-953a-89a33ec24876 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:44.090561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f47eec-1796-4530-953a-89a33ec24876 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:44.092067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 160/320] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:44 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:40:44.097382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95078fbe-48df-4097-b97f-e76ed78d55ff admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:44.106643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95078fbe-48df-4097-b97f-e76ed78d55ff admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:44.110899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f656ad9-af78-4740-acd3-99574f0dad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:44.111693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f656ad9-af78-4740-acd3-99574f0dad70 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:44.111977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f656ad9-af78-4740-acd3-99574f0dad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:44.112251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f656ad9-af78-4740-acd3-99574f0dad70 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/groups/e482787031664e62b9727f2427134448/roles/9aea1c8bef3a4845b02455d1934a3771` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:44.114227 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f656ad9-af78-4740-acd3-99574f0dad70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f9d2579dd34d1e93b70d9b69e00f17, group_id=e482787031664e62b9727f2427134448, role_id=9aea1c8bef3a4845b02455d1934a3771)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:44.116866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f656ad9-af78-4740-acd3-99574f0dad70 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:44.129692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 161/321] 10.222.0.57 () {58 vars in 1463 bytes} [Mon Oct 25 14:40:44 2021] PUT /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17/groups/e482787031664e62b9727f2427134448/roles/9aea1c8bef3a4845b02455d1934a3771 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:40:46.174730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab784d-d47e-44b9-adf5-6181876e1e21 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:46.175247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab784d-d47e-44b9-adf5-6181876e1e21 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:46.175247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab784d-d47e-44b9-adf5-6181876e1e21 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:46.176863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 161/322] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:46.182464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85f00-4189-46d5-be68-1dbc36eb7018 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:46.182886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85f00-4189-46d5-be68-1dbc36eb7018 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:46.183016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85f00-4189-46d5-be68-1dbc36eb7018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:46.205968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-cbc85f00-4189-46d5-be68-1dbc36eb7018 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:46.207123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-cbc85f00-4189-46d5-be68-1dbc36eb7018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:46.270036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 162/323] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:40:46.292418 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab784d-d47e-44b9-adf5-6181876e1e21 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:46.304081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab784d-d47e-44b9-adf5-6181876e1e21 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:46.307960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebb483-a214-44e6-84ba-198aa10edde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:46.308683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebb483-a214-44e6-84ba-198aa10edde9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:46.308969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebb483-a214-44e6-84ba-198aa10edde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:46.309249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebb483-a214-44e6-84ba-198aa10edde9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:46.320887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebb483-a214-44e6-84ba-198aa10edde9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:46.327765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-83ebb483-a214-44e6-84ba-198aa10edde9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:40:46.329477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 162/324] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:40:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:46.335168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc85f00-4189-46d5-be68-1dbc36eb7018 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:46.343614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc85f00-4189-46d5-be68-1dbc36eb7018 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:46.347628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:46.348210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:46.348491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:46.348766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:46.349470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:46.349764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:46.351359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:46.359725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 163/325] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:40:46.365206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebb483-a214-44e6-84ba-198aa10edde9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:46.374502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebb483-a214-44e6-84ba-198aa10edde9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:46.379070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d866de-fd51-4463-82f8-20a02a365fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:46.379625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d866de-fd51-4463-82f8-20a02a365fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:46.379917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d866de-fd51-4463-82f8-20a02a365fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:46.380199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d866de-fd51-4463-82f8-20a02a365fc9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:46.387832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d866de-fd51-4463-82f8-20a02a365fc9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:46.389570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d866de-fd51-4463-82f8-20a02a365fc9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:46.398635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 163/326] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:46.404045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:46.413183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2863a-9411-4209-9c5f-7debe7d458ac admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:46.417068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534227b7-9483-423d-bac8-16bb4d69a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:46.417838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534227b7-9483-423d-bac8-16bb4d69a188 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:46.418119 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534227b7-9483-423d-bac8-16bb4d69a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:46.418392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534227b7-9483-423d-bac8-16bb4d69a188 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:46.419473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534227b7-9483-423d-bac8-16bb4d69a188 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:46.421482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534227b7-9483-423d-bac8-16bb4d69a188 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:46.423016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 164/327] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:46 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:46.428525 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d866de-fd51-4463-82f8-20a02a365fc9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:46.437636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d866de-fd51-4463-82f8-20a02a365fc9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:46.442502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0ba48-d309-4278-9588-e2112852ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:46.443316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ba48-d309-4278-9588-e2112852ff3a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:46.443605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ba48-d309-4278-9588-e2112852ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:46.443886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ba48-d309-4278-9588-e2112852ff3a admin admin] PATH_INFO: `/v3/groups/e482787031664e62b9727f2427134448` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:46.445047 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0ba48-d309-4278-9588-e2112852ff3a admin admin] RBAC: Authorizing `identity:get_group(group_id=e482787031664e62b9727f2427134448)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:46.447041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0ba48-d309-4278-9588-e2112852ff3a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:46.448600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 164/328] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:46 2021] GET /identity/v3/groups/e482787031664e62b9727f2427134448 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:46.455252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534227b7-9483-423d-bac8-16bb4d69a188 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:46.465019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534227b7-9483-423d-bac8-16bb4d69a188 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:46.469134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5200659-66fe-4759-93da-801ccb0e337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:46.469721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200659-66fe-4759-93da-801ccb0e337d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:46.470007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200659-66fe-4759-93da-801ccb0e337d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:46.470286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200659-66fe-4759-93da-801ccb0e337d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:46.471093 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5200659-66fe-4759-93da-801ccb0e337d admin admin] RBAC: Adding query filter params (group.id=e482787031664e62b9727f2427134448, role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:46.471397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5200659-66fe-4759-93da-801ccb0e337d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:46.473234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5200659-66fe-4759-93da-801ccb0e337d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:46.479398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 165/329] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:46 2021] GET /identity/v3/role_assignments?group.id=e482787031664e62b9727f2427134448&scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:40:48.688161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319a6a-a050-4fdb-a6f0-69772631e651 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:48.688687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319a6a-a050-4fdb-a6f0-69772631e651 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:48.688798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319a6a-a050-4fdb-a6f0-69772631e651 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:48.690382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 165/330] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:48.695691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ee94-0905-4ee1-8ab7-a98f2f75f4d6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:48.696136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ee94-0905-4ee1-8ab7-a98f2f75f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:48.696262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ee94-0905-4ee1-8ab7-a98f2f75f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:48.717628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2589ee94-0905-4ee1-8ab7-a98f2f75f4d6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:48.718788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2589ee94-0905-4ee1-8ab7-a98f2f75f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:48.726108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 166/331] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:40:48.748718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f319a6a-a050-4fdb-a6f0-69772631e651 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:48.760413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f319a6a-a050-4fdb-a6f0-69772631e651 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:48.764504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe409-d844-431c-b006-95a8dfa688e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:48.765216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe409-d844-431c-b006-95a8dfa688e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:48.765502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe409-d844-431c-b006-95a8dfa688e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:48.765779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe409-d844-431c-b006-95a8dfa688e1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:48.778379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbe409-d844-431c-b006-95a8dfa688e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:48.787458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-6ebbe409-d844-431c-b006-95a8dfa688e1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:40:48.788815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 166/332] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:40:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:48.795086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589ee94-0905-4ee1-8ab7-a98f2f75f4d6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:48.804349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589ee94-0905-4ee1-8ab7-a98f2f75f4d6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:48.808472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:48.809070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:48.809359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:48.809641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:48.810353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:48.810682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:48.812270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:48.820818 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 167/333] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:48.826254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe409-d844-431c-b006-95a8dfa688e1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:48.837476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe409-d844-431c-b006-95a8dfa688e1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:48.841423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d62a8d-307b-4137-950d-9913d79ecaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:48.841985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62a8d-307b-4137-950d-9913d79ecaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:48.842267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62a8d-307b-4137-950d-9913d79ecaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:48.842584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62a8d-307b-4137-950d-9913d79ecaf2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:48.850628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d62a8d-307b-4137-950d-9913d79ecaf2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:48.852334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d62a8d-307b-4137-950d-9913d79ecaf2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:48.861546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 167/334] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:40:48.867140 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:48.876489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfec68-dc0b-4b5d-8197-264be5cf5f0b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:48.880558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c90f4-b09a-4fe3-9e21-5498c3559cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:48.881339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c90f4-b09a-4fe3-9e21-5498c3559cda admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:48.881630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c90f4-b09a-4fe3-9e21-5498c3559cda admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:48.881911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c90f4-b09a-4fe3-9e21-5498c3559cda admin admin] PATH_INFO: `/v3/projects/8de23d66a8de47dbaa30df02a935afe2` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:48.883012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c90f4-b09a-4fe3-9e21-5498c3559cda admin admin] RBAC: Authorizing `identity:get_project(project_id=8de23d66a8de47dbaa30df02a935afe2)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:48.884785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c90f4-b09a-4fe3-9e21-5498c3559cda admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:48.886308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 168/335] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:48 2021] GET /identity/v3/projects/8de23d66a8de47dbaa30df02a935afe2 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:48.892093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d62a8d-307b-4137-950d-9913d79ecaf2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:48.900668 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d62a8d-307b-4137-950d-9913d79ecaf2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:48.904830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88349cf-0adc-4492-9cd8-f857fa6efecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:48.905637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88349cf-0adc-4492-9cd8-f857fa6efecf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:48.905919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88349cf-0adc-4492-9cd8-f857fa6efecf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:48.906196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88349cf-0adc-4492-9cd8-f857fa6efecf admin admin] PATH_INFO: `/v3/groups/3375e71fbd3f42babad23c8fc69ffef0` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:48.912375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88349cf-0adc-4492-9cd8-f857fa6efecf admin admin] RBAC: Authorizing `identity:get_group(group_id=3375e71fbd3f42babad23c8fc69ffef0)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:48.914291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88349cf-0adc-4492-9cd8-f857fa6efecf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:48.915935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 168/336] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:48 2021] GET /identity/v3/groups/3375e71fbd3f42babad23c8fc69ffef0 => generated 229 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:48.922222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c90f4-b09a-4fe3-9e21-5498c3559cda admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:48.932146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c90f4-b09a-4fe3-9e21-5498c3559cda admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:48.936391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a272a-8083-4539-9607-52fbcc46a765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:48.936988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a272a-8083-4539-9607-52fbcc46a765 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:48.937278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a272a-8083-4539-9607-52fbcc46a765 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:48.937559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a272a-8083-4539-9607-52fbcc46a765 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:48.938471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a272a-8083-4539-9607-52fbcc46a765 admin admin] RBAC: Adding query filter params (group.id=3375e71fbd3f42babad23c8fc69ffef0, role.id=98f77a1006404111a8be8686551c8675, scope.project.id=8de23d66a8de47dbaa30df02a935afe2) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:48.938724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a272a-8083-4539-9607-52fbcc46a765 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:48.940566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a272a-8083-4539-9607-52fbcc46a765 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:48.946415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 169/337] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:48 2021] GET /identity/v3/role_assignments?group.id=3375e71fbd3f42babad23c8fc69ffef0&scope.project.id=8de23d66a8de47dbaa30df02a935afe2&role.id=98f77a1006404111a8be8686551c8675 => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:51.013513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72342b9-c60c-43ef-b3cf-85ee2d3931bd None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:51.014022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72342b9-c60c-43ef-b3cf-85ee2d3931bd None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:51.014107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72342b9-c60c-43ef-b3cf-85ee2d3931bd None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:51.015774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 169/338] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:51.021511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd307-cf2b-494f-a3a8-51412e9c1a74 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:51.021920 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd307-cf2b-494f-a3a8-51412e9c1a74 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:51.022069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd307-cf2b-494f-a3a8-51412e9c1a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:51.043333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-dc1fd307-cf2b-494f-a3a8-51412e9c1a74 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:51.044469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-dc1fd307-cf2b-494f-a3a8-51412e9c1a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:51.051106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 170/339] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:40:51.072645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72342b9-c60c-43ef-b3cf-85ee2d3931bd None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:51.084897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72342b9-c60c-43ef-b3cf-85ee2d3931bd None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:51.088664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cad7c-0ecf-42c4-aee7-3e7ca022a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:51.089368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cad7c-0ecf-42c4-aee7-3e7ca022a262 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:51.089649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cad7c-0ecf-42c4-aee7-3e7ca022a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:51.089920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cad7c-0ecf-42c4-aee7-3e7ca022a262 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:51.101636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cad7c-0ecf-42c4-aee7-3e7ca022a262 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:51.107984 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-e46cad7c-0ecf-42c4-aee7-3e7ca022a262 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:40:51.109315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 170/340] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:40:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:51.115044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd307-cf2b-494f-a3a8-51412e9c1a74 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:51.123592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd307-cf2b-494f-a3a8-51412e9c1a74 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:51.128156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:51.128742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:51.129030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:51.129306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:51.130009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:51.130302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:51.131994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:51.140327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 171/341] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:51.146238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cad7c-0ecf-42c4-aee7-3e7ca022a262 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:51.155927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cad7c-0ecf-42c4-aee7-3e7ca022a262 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:51.160003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd6ded-2cfb-4d4d-b95a-0739886a12ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:51.160762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd6ded-2cfb-4d4d-b95a-0739886a12ed admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:51.161043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd6ded-2cfb-4d4d-b95a-0739886a12ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:51.161316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd6ded-2cfb-4d4d-b95a-0739886a12ed admin admin] PATH_INFO: `/v3/groups/3375e71fbd3f42babad23c8fc69ffef0` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:51.162382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd6ded-2cfb-4d4d-b95a-0739886a12ed admin admin] RBAC: Authorizing `identity:get_group(group_id=3375e71fbd3f42babad23c8fc69ffef0)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:51.164250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd6ded-2cfb-4d4d-b95a-0739886a12ed admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:51.165651 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 171/342] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:51 2021] GET /identity/v3/groups/3375e71fbd3f42babad23c8fc69ffef0 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:51.170825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:51.180456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89405017-6189-4ef0-a9c6-71b2b2146d87 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:51.184443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854d451-bba8-4e47-9eb1-9d459b400f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:51.185215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d451-bba8-4e47-9eb1-9d459b400f66 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:51.185498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d451-bba8-4e47-9eb1-9d459b400f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:51.185776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d451-bba8-4e47-9eb1-9d459b400f66 admin admin] PATH_INFO: `/v3/projects/8de23d66a8de47dbaa30df02a935afe2` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:51.186876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854d451-bba8-4e47-9eb1-9d459b400f66 admin admin] RBAC: Authorizing `identity:get_project(project_id=8de23d66a8de47dbaa30df02a935afe2)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:51.189252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854d451-bba8-4e47-9eb1-9d459b400f66 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:51.190780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 172/343] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:51 2021] GET /identity/v3/projects/8de23d66a8de47dbaa30df02a935afe2 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:51.196092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd6ded-2cfb-4d4d-b95a-0739886a12ed admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:51.205237 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd6ded-2cfb-4d4d-b95a-0739886a12ed admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:51.209365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce28b0a-2768-4f5a-9c42-e7945c73dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:51.210200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28b0a-2768-4f5a-9c42-e7945c73dce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:51.210526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28b0a-2768-4f5a-9c42-e7945c73dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:51.210802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28b0a-2768-4f5a-9c42-e7945c73dce6 admin admin] PATH_INFO: `/v3/projects/8de23d66a8de47dbaa30df02a935afe2/groups/3375e71fbd3f42babad23c8fc69ffef0/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:51.212650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce28b0a-2768-4f5a-9c42-e7945c73dce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de23d66a8de47dbaa30df02a935afe2, group_id=3375e71fbd3f42babad23c8fc69ffef0, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:51.215357 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce28b0a-2768-4f5a-9c42-e7945c73dce6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:51.228676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 172/344] 10.222.0.57 () {58 vars in 1463 bytes} [Mon Oct 25 14:40:51 2021] PUT /identity/v3/projects/8de23d66a8de47dbaa30df02a935afe2/groups/3375e71fbd3f42babad23c8fc69ffef0/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:40:53.302141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bea2b-305b-4d7e-8308-9291f12557cf None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:53.302679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bea2b-305b-4d7e-8308-9291f12557cf None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:53.302761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bea2b-305b-4d7e-8308-9291f12557cf None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:53.304392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 173/345] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:53.311061 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61307e-bbe7-4ca0-8206-103005e71dcf None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:53.311473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61307e-bbe7-4ca0-8206-103005e71dcf None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:53.311612 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61307e-bbe7-4ca0-8206-103005e71dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:53.335045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-da61307e-bbe7-4ca0-8206-103005e71dcf None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:53.336170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-da61307e-bbe7-4ca0-8206-103005e71dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:53.400355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 173/346] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:53.423890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bea2b-305b-4d7e-8308-9291f12557cf None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:53.435544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bea2b-305b-4d7e-8308-9291f12557cf None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:53.440007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b07bd0-3a9b-4ed1-bed4-9a9d1a562722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:53.440719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07bd0-3a9b-4ed1-bed4-9a9d1a562722 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:53.441005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07bd0-3a9b-4ed1-bed4-9a9d1a562722 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:53.441282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07bd0-3a9b-4ed1-bed4-9a9d1a562722 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:53.453145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b07bd0-3a9b-4ed1-bed4-9a9d1a562722 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:53.459602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-c3b07bd0-3a9b-4ed1-bed4-9a9d1a562722 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:40:53.460699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 174/347] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:40:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:53.466538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61307e-bbe7-4ca0-8206-103005e71dcf None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:53.475345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61307e-bbe7-4ca0-8206-103005e71dcf None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:53.479670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:53.480282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:53.480556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:53.480833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:53.481548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:53.481843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:53.483446 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:53.493502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 174/348] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:40:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:53.499469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b07bd0-3a9b-4ed1-bed4-9a9d1a562722 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:53.509878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b07bd0-3a9b-4ed1-bed4-9a9d1a562722 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:53.514012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119cd4-9e78-4268-9ddd-33ba9131a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:53.514645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119cd4-9e78-4268-9ddd-33ba9131a041 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:53.514931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119cd4-9e78-4268-9ddd-33ba9131a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:53.515208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119cd4-9e78-4268-9ddd-33ba9131a041 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:53.524389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82119cd4-9e78-4268-9ddd-33ba9131a041 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:53.526229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82119cd4-9e78-4268-9ddd-33ba9131a041 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:53.536022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 175/349] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:53.542137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:53.552483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995847a-a828-4ee0-8bab-2ba8c41f1622 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:53.556483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535ba38-6eb9-48de-94bf-b7b8a8f0d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:53.557267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535ba38-6eb9-48de-94bf-b7b8a8f0d48a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:53.557559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535ba38-6eb9-48de-94bf-b7b8a8f0d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:53.557843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535ba38-6eb9-48de-94bf-b7b8a8f0d48a admin admin] PATH_INFO: `/v3/projects/8de23d66a8de47dbaa30df02a935afe2` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:53.558963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535ba38-6eb9-48de-94bf-b7b8a8f0d48a admin admin] RBAC: Authorizing `identity:get_project(project_id=8de23d66a8de47dbaa30df02a935afe2)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:53.560730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535ba38-6eb9-48de-94bf-b7b8a8f0d48a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:53.565830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 175/350] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:40:53 2021] GET /identity/v3/projects/8de23d66a8de47dbaa30df02a935afe2 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:53.571383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119cd4-9e78-4268-9ddd-33ba9131a041 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:53.580498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119cd4-9e78-4268-9ddd-33ba9131a041 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:53.585348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42f668-5d52-46e1-8e11-f48f8ca378aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:53.586132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42f668-5d52-46e1-8e11-f48f8ca378aa admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:53.586492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42f668-5d52-46e1-8e11-f48f8ca378aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:53.586721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42f668-5d52-46e1-8e11-f48f8ca378aa admin admin] PATH_INFO: `/v3/groups/3375e71fbd3f42babad23c8fc69ffef0` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:53.587809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42f668-5d52-46e1-8e11-f48f8ca378aa admin admin] RBAC: Authorizing `identity:get_group(group_id=3375e71fbd3f42babad23c8fc69ffef0)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:53.589691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42f668-5d52-46e1-8e11-f48f8ca378aa admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:53.591179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 176/351] 10.222.0.57 () {56 vars in 1201 bytes} [Mon Oct 25 14:40:53 2021] GET /identity/v3/groups/3375e71fbd3f42babad23c8fc69ffef0 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:53.597534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535ba38-6eb9-48de-94bf-b7b8a8f0d48a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:53.608078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535ba38-6eb9-48de-94bf-b7b8a8f0d48a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:53.612808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6a886-1f3a-43a5-a856-edaf6b3c8ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:53.613388 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a886-1f3a-43a5-a856-edaf6b3c8ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:53.613674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a886-1f3a-43a5-a856-edaf6b3c8ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:53.613957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a886-1f3a-43a5-a856-edaf6b3c8ec8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:53.614769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6a886-1f3a-43a5-a856-edaf6b3c8ec8 admin admin] RBAC: Adding query filter params (group.id=3375e71fbd3f42babad23c8fc69ffef0, role.id=98f77a1006404111a8be8686551c8675, scope.project.id=8de23d66a8de47dbaa30df02a935afe2) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:53.615074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6a886-1f3a-43a5-a856-edaf6b3c8ec8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:53.616903 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6a886-1f3a-43a5-a856-edaf6b3c8ec8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:53.622827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 176/352] 10.222.0.57 () {56 vars in 1397 bytes} [Mon Oct 25 14:40:53 2021] GET /identity/v3/role_assignments?group.id=3375e71fbd3f42babad23c8fc69ffef0&scope.project.id=8de23d66a8de47dbaa30df02a935afe2&role.id=98f77a1006404111a8be8686551c8675 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:56.957998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c748d-ce3f-474d-ab5d-fc22061e6ba5 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:56.958555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c748d-ce3f-474d-ab5d-fc22061e6ba5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:56.958555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c748d-ce3f-474d-ab5d-fc22061e6ba5 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:56.960235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 177/353] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:56.965349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f19e-6d71-4cfa-a748-ee7707402674 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:56.965738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f19e-6d71-4cfa-a748-ee7707402674 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:56.965920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f19e-6d71-4cfa-a748-ee7707402674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:56.988770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-91f3f19e-6d71-4cfa-a748-ee7707402674 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:56.989906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-91f3f19e-6d71-4cfa-a748-ee7707402674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:56.996673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 177/354] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:40:57.019443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c748d-ce3f-474d-ab5d-fc22061e6ba5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:57.030820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c748d-ce3f-474d-ab5d-fc22061e6ba5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:57.035133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:57.035842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:57.036124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:57.036407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:57.048457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:57.050287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:57.066651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:40:57.067709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 178/355] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:40:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:57.073386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3f19e-6d71-4cfa-a748-ee7707402674 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:57.082034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3f19e-6d71-4cfa-a748-ee7707402674 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:57.086082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0aca-3620-4391-b883-b32159219617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:57.086698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0aca-3620-4391-b883-b32159219617 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:57.086986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0aca-3620-4391-b883-b32159219617 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:57.087264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0aca-3620-4391-b883-b32159219617 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:57.087955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0aca-3620-4391-b883-b32159219617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:57.088254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0aca-3620-4391-b883-b32159219617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:57.089817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0aca-3620-4391-b883-b32159219617 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:57.102533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 178/356] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:40:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:57.107760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:57.117698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097978c-2488-4a52-9ade-4f02ec384f4d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:57.121570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f3010-ea0a-41cd-9bba-ae3cb8ea53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:57.122147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3010-ea0a-41cd-9bba-ae3cb8ea53cc admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:57.122453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3010-ea0a-41cd-9bba-ae3cb8ea53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:57.122733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3010-ea0a-41cd-9bba-ae3cb8ea53cc admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:57.123370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f3010-ea0a-41cd-9bba-ae3cb8ea53cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:57.124361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-362f3010-ea0a-41cd-9bba-ae3cb8ea53cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:40:57.124361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:40:57.124361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:40:57.125547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f3010-ea0a-41cd-9bba-ae3cb8ea53cc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:57.149544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 179/357] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:40:57 2021] POST /identity/v3/users => generated 246 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:40:59.288515 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea3bb-f6f9-47ad-a9cf-c2eefb4040b1 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.289033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea3bb-f6f9-47ad-a9cf-c2eefb4040b1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.289033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea3bb-f6f9-47ad-a9cf-c2eefb4040b1 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.290709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 179/358] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:40:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:40:59.295867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe080-ce4a-429f-81dc-e38125b14c98 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.296259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe080-ce4a-429f-81dc-e38125b14c98 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.296425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe080-ce4a-429f-81dc-e38125b14c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.318461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b6efe080-ce4a-429f-81dc-e38125b14c98 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:40:59.319604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b6efe080-ce4a-429f-81dc-e38125b14c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:40:59.326377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 180/359] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:40:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:40:59.349224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea3bb-f6f9-47ad-a9cf-c2eefb4040b1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.361040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea3bb-f6f9-47ad-a9cf-c2eefb4040b1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.364901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd9de-e666-4590-bc02-b5c773293f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.365610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd9de-e666-4590-bc02-b5c773293f6f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.365889 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd9de-e666-4590-bc02-b5c773293f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.366163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd9de-e666-4590-bc02-b5c773293f6f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.377384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dd9de-e666-4590-bc02-b5c773293f6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:40:59.383875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-9f5dd9de-e666-4590-bc02-b5c773293f6f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:40:59.385132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 180/360] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:40:59.391571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efe080-ce4a-429f-81dc-e38125b14c98 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.400109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efe080-ce4a-429f-81dc-e38125b14c98 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.404247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.404841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.405129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.405417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.406126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:59.406443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.408039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.416169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 181/361] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:59.421488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd9de-e666-4590-bc02-b5c773293f6f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.431664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd9de-e666-4590-bc02-b5c773293f6f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.435656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.436359 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.436644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.436924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.448587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.450383 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.467335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:40:59.468417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 181/362] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:59.474064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.483922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acab1-9d12-4ba1-9d83-47704ca5bfb2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.488749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.489362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.489650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.489931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.490683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:59.490981 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.492016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:40:59.492016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:40:59.492016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:40:59.492910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.507270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 182/363] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:59.512963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.522571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd56af-a8cb-422b-851a-ea16dad69574 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.526656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.527377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.527664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.527941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.541085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.543059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.561243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:40:59.562351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 182/364] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:59.568636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.577984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c003ef2-859e-46dd-8e01-716d70d2230c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.581940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.582559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.582849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.583127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.583899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:59.584194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.585186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:40:59.585186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:40:59.585186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:40:59.586313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.615515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 183/365] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:59.621077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.630965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4d2b5-9fde-4d04-ae97-ba7e0f05426a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.635058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91889b-c65b-4a73-beaa-b7606661dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.635626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91889b-c65b-4a73-beaa-b7606661dc1e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.635910 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91889b-c65b-4a73-beaa-b7606661dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.636187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91889b-c65b-4a73-beaa-b7606661dc1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.644070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91889b-c65b-4a73-beaa-b7606661dc1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.645796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91889b-c65b-4a73-beaa-b7606661dc1e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.654653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 183/366] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:40:59.660396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.669779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139ca8-730d-4674-89a8-0ad5aed8bc8c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.674308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.675118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.675398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.675676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.691501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.693339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.710444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:40:59.711536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 184/367] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:59.717095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91889b-c65b-4a73-beaa-b7606661dc1e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.725957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91889b-c65b-4a73-beaa-b7606661dc1e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.730028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.730634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.730921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.731197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.731875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:59.732175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.733977 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.746866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 184/368] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:59.753699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.763175 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d599d-5690-407e-aae3-8a5d07768864 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.767212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.767933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.768222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.768501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.776891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.779143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.793229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:40:59.794338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 185/369] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:40:59.800800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.810516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98450931-8522-4056-8de8-f8ab76619310 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.814799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2311572-d446-46a0-97dd-8e24386fc88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.815389 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2311572-d446-46a0-97dd-8e24386fc88b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.815676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2311572-d446-46a0-97dd-8e24386fc88b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.815958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2311572-d446-46a0-97dd-8e24386fc88b admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.816705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2311572-d446-46a0-97dd-8e24386fc88b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:59.817007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2311572-d446-46a0-97dd-8e24386fc88b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.818009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-f2311572-d446-46a0-97dd-8e24386fc88b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:40:59.818009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:40:59.818009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:40:59.819161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2311572-d446-46a0-97dd-8e24386fc88b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.832750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 185/370] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:40:59.838345 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:40:59.848162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ece7ea-31c0-4342-a983-a66090460670 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:40:59.852121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5e90b-42d2-4fa8-911a-f6a05bc9ef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:40:59.852691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e90b-42d2-4fa8-911a-f6a05bc9ef35 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:40:59.852973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e90b-42d2-4fa8-911a-f6a05bc9ef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:40:59.853247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e90b-42d2-4fa8-911a-f6a05bc9ef35 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:40:59.854012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5e90b-42d2-4fa8-911a-f6a05bc9ef35 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=baae94f89c07491a875477ede4e06b57) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:40:59.854311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5e90b-42d2-4fa8-911a-f6a05bc9ef35 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:40:59.856154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5e90b-42d2-4fa8-911a-f6a05bc9ef35 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:40:59.862217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 186/371] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:40:59 2021] GET /identity/v3/role_assignments?user.id=baae94f89c07491a875477ede4e06b57&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:01.914075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921a91-eef7-4e17-aebd-16afba0b422c None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:01.914683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921a91-eef7-4e17-aebd-16afba0b422c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:01.914683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921a91-eef7-4e17-aebd-16afba0b422c None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:01.916327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 186/372] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:01.921551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e817b-ff17-4b1e-ad00-d93d3cfde879 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:01.922504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e817b-ff17-4b1e-ad00-d93d3cfde879 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:01.922631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e817b-ff17-4b1e-ad00-d93d3cfde879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:01.945164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5a6e817b-ff17-4b1e-ad00-d93d3cfde879 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:01.946323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5a6e817b-ff17-4b1e-ad00-d93d3cfde879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:01.953200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 187/373] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:01.975027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b921a91-eef7-4e17-aebd-16afba0b422c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:01.987366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b921a91-eef7-4e17-aebd-16afba0b422c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:01.991250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d66b-3c07-4bfe-a639-01168a4f6831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:01.991961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d66b-3c07-4bfe-a639-01168a4f6831 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:01.992244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d66b-3c07-4bfe-a639-01168a4f6831 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:01.992519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d66b-3c07-4bfe-a639-01168a4f6831 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.004255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d66b-3c07-4bfe-a639-01168a4f6831 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:02.010867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-9da9d66b-3c07-4bfe-a639-01168a4f6831 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:41:02.011999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 187/374] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:41:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:02.017777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e817b-ff17-4b1e-ad00-d93d3cfde879 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.026454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e817b-ff17-4b1e-ad00-d93d3cfde879 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.030495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.031589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.031868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.032141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.032839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:02.033129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.034711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.042927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 188/375] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:02.048868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d66b-3c07-4bfe-a639-01168a4f6831 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.059869 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d66b-3c07-4bfe-a639-01168a4f6831 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.063912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.064620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.064908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.065190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.076313 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.078072 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.095425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:02.096508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 188/376] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:02.101968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.111968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd3756-8f6b-4a5e-b8c1-92457f4dba6c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.115921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.116493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.116780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.117055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.117729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:02.118023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.119622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.131602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 189/377] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:02.137049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.146263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece45ed-3252-4962-9b5c-995568642bfb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.150276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.151019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.151307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.151586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.164393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.166425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.184281 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:41:02.185367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 189/378] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:02.190921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.200678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf5a5-2b44-4e78-9902-4d7222cbc965 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.204940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.205565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.205853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.206131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.206985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:02.207294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.209174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.240913 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 190/379] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:02.246688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.256188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62a937-6493-464f-82d4-a4650209a8f0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.260214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.260924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.261208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.261487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.273376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.275221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.292442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:02.293535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 190/380] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:02.299886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.309275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9f3bb-b5d5-433a-8874-f553d2ffb2c1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.313318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.313910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.314198 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.314516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.315199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:02.315498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.317074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.329239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 191/381] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:02.334664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.344495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabbd2d-6746-47b5-a405-e5ee0f90d284 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.348516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.349231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.349515 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.349792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.358300 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.361205 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.374894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:02.376019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 191/382] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:02.385719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.402682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31319b3-a096-4b7c-956c-008f5494fdc7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.410000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1baddd-b6a6-4167-90cc-058791c6d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.411078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1baddd-b6a6-4167-90cc-058791c6d91f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.411601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1baddd-b6a6-4167-90cc-058791c6d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.412123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1baddd-b6a6-4167-90cc-058791c6d91f admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.413481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1baddd-b6a6-4167-90cc-058791c6d91f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:02.414028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1baddd-b6a6-4167-90cc-058791c6d91f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.415817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-ac1baddd-b6a6-4167-90cc-058791c6d91f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:02.415817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:41:02.415817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:41:02.418092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1baddd-b6a6-4167-90cc-058791c6d91f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.440681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 192/383] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:02.446231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:02.456525 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db2947-8a63-4c03-b073-9ff5c48e977c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:02.460539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6ae85-ad90-48fc-8a6b-d35619ea7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:02.461353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ae85-ad90-48fc-8a6b-d35619ea7bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:02.461633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ae85-ad90-48fc-8a6b-d35619ea7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:02.461908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ae85-ad90-48fc-8a6b-d35619ea7bc3 admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/baae94f89c07491a875477ede4e06b57/roles/7aaa6f36ae64405697ffb965e125aae6` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:02.482140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6ae85-ad90-48fc-8a6b-d35619ea7bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=baae94f89c07491a875477ede4e06b57, role_id=7aaa6f36ae64405697ffb965e125aae6)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:02.485036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6ae85-ad90-48fc-8a6b-d35619ea7bc3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:02.497408 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 192/384] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:41:02 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/baae94f89c07491a875477ede4e06b57/roles/7aaa6f36ae64405697ffb965e125aae6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:41:04.563809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465cff-d5bf-4ea3-8722-09ff5a64008d None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.564357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465cff-d5bf-4ea3-8722-09ff5a64008d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.564357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465cff-d5bf-4ea3-8722-09ff5a64008d None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.566043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 193/385] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:04.571119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e03343-30d4-4f7b-826c-567a3f2e1790 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.571503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e03343-30d4-4f7b-826c-567a3f2e1790 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.571679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e03343-30d4-4f7b-826c-567a3f2e1790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.593851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c5e03343-30d4-4f7b-826c-567a3f2e1790 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:04.595014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c5e03343-30d4-4f7b-826c-567a3f2e1790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:04.659184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 193/386] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:04.681680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465cff-d5bf-4ea3-8722-09ff5a64008d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:04.693719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465cff-d5bf-4ea3-8722-09ff5a64008d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:04.697545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3eb5b-d8d4-4936-83fc-e15f7c42b18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:04.698257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3eb5b-d8d4-4936-83fc-e15f7c42b18d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.698569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3eb5b-d8d4-4936-83fc-e15f7c42b18d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.698844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3eb5b-d8d4-4936-83fc-e15f7c42b18d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.709593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3eb5b-d8d4-4936-83fc-e15f7c42b18d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:04.716173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-51b3eb5b-d8d4-4936-83fc-e15f7c42b18d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:41:04.717263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 194/387] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:41:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:04.722948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e03343-30d4-4f7b-826c-567a3f2e1790 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:04.731412 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e03343-30d4-4f7b-826c-567a3f2e1790 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:04.736180 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:04.736760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.737040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.737317 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.738022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:04.738315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:04.739919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:04.747952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 194/388] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:41:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:04.753772 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3eb5b-d8d4-4936-83fc-e15f7c42b18d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:04.763502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3eb5b-d8d4-4936-83fc-e15f7c42b18d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:04.767769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:04.768477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.768765 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.769039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.780294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:04.782105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:04.800202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:04.801312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 195/389] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:04.806941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:04.817057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955b084-04e2-417e-97fa-8a1fa02c9208 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:04.824558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:04.825160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.825444 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.825929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.826664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:04.826960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:04.828723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:04.842033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 195/390] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:04.847777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:04.860047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8052f-647a-42ac-af1c-db7b67c22b65 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:04.864886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:04.865638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.865921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.866224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.880457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:04.882571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:04.900772 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:41:04.901899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 196/391] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:41:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:04.907589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:04.917051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4f433-5520-4e8c-b47a-29138f13f338 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:04.921176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:04.922257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.922587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.922870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.923659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:04.923958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:04.924957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:04.924957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:41:04.924957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:41:04.926079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:04.955537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 196/392] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:41:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:04.961126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:04.970548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117ff1-2c16-4c97-9e82-249c54bd03f2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:04.974558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc702f-2a0f-4fbc-a415-41cb4851d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:04.975126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc702f-2a0f-4fbc-a415-41cb4851d01f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:04.975406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc702f-2a0f-4fbc-a415-41cb4851d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:04.975673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc702f-2a0f-4fbc-a415-41cb4851d01f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:04.983195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc702f-2a0f-4fbc-a415-41cb4851d01f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:04.985719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc702f-2a0f-4fbc-a415-41cb4851d01f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:04.994215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 197/393] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:41:05.000325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:05.009729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acfa0e-1a51-4b7d-8c48-aacaa287dbe6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:05.013870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:05.014636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:05.014929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:05.015211 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:05.028358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:05.030178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:05.048012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:05.049113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 197/394] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:05.054751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc702f-2a0f-4fbc-a415-41cb4851d01f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:05.063638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc702f-2a0f-4fbc-a415-41cb4851d01f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:05.067910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:05.068448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:05.068736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:05.069018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:05.069700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:05.069998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:05.071642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:05.084466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 198/395] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:05.089980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:05.099880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978babac-7c0b-4a92-8c2a-ab3f90bb1fcb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:05.103901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:05.104614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:05.104901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:05.105182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:05.114542 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:05.116473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:05.129984 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:05.131109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 198/396] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:05.137498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:05.147453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358b23a-b6f4-410d-ae85-473560fff657 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:05.151563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94415f4b-cedf-4254-b755-24b81f68fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:05.152144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94415f4b-cedf-4254-b755-24b81f68fd66 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:05.152429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94415f4b-cedf-4254-b755-24b81f68fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:05.152701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94415f4b-cedf-4254-b755-24b81f68fd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:05.153436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94415f4b-cedf-4254-b755-24b81f68fd66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:05.153731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94415f4b-cedf-4254-b755-24b81f68fd66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:05.155690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94415f4b-cedf-4254-b755-24b81f68fd66 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:05.168929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 199/397] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:05.175396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:05.184742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19800c66-07f5-4e1b-b011-186182b9dc3d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:05.188910 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b4794-b40b-42e6-9ec2-8463d4920363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:05.189484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4794-b40b-42e6-9ec2-8463d4920363 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:05.189775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4794-b40b-42e6-9ec2-8463d4920363 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:05.190057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4794-b40b-42e6-9ec2-8463d4920363 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:05.190880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b4794-b40b-42e6-9ec2-8463d4920363 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=baae94f89c07491a875477ede4e06b57) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:05.191183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b4794-b40b-42e6-9ec2-8463d4920363 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:05.193003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b4794-b40b-42e6-9ec2-8463d4920363 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:05.198723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 199/398] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:41:05 2021] GET /identity/v3/role_assignments?user.id=baae94f89c07491a875477ede4e06b57&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:07.314852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891362-c054-4ae8-96c9-a1ed4ff1a9a3 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.315407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891362-c054-4ae8-96c9-a1ed4ff1a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.315407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891362-c054-4ae8-96c9-a1ed4ff1a9a3 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.317076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 200/399] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:07.322115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dab09-7312-4155-b965-dcdc96572f1b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.322546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dab09-7312-4155-b965-dcdc96572f1b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.322833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dab09-7312-4155-b965-dcdc96572f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.345139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-824dab09-7312-4155-b965-dcdc96572f1b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:07.346278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-824dab09-7312-4155-b965-dcdc96572f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:07.353104 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 200/400] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:07.376196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de891362-c054-4ae8-96c9-a1ed4ff1a9a3 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.387690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de891362-c054-4ae8-96c9-a1ed4ff1a9a3 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.392158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deabf07-bed8-4f01-85af-747828d368c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.392873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deabf07-bed8-4f01-85af-747828d368c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.393161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deabf07-bed8-4f01-85af-747828d368c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.393441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deabf07-bed8-4f01-85af-747828d368c8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.404267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deabf07-bed8-4f01-85af-747828d368c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:07.410947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-3deabf07-bed8-4f01-85af-747828d368c8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:41:07.412024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 201/401] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:07.417581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dab09-7312-4155-b965-dcdc96572f1b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.426123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dab09-7312-4155-b965-dcdc96572f1b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.430122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.430738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.431022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.431296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.431995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:07.432288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.433840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.442577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 201/402] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:07.448009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deabf07-bed8-4f01-85af-747828d368c8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.459542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deabf07-bed8-4f01-85af-747828d368c8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.463593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.464301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.464595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.464903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.475933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.477759 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.585991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:07.587069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 202/403] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:07.592912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.603014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125edd0a-bb80-48e8-a264-976b3667adbf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.607278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.607887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.608180 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.608462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.609435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:07.609737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.611404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.625439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 202/404] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:07.630940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.640943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b9013-346f-425b-8bd0-20d374d69229 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.645015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.645735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.646021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.646295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.660037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.662103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.680274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:41:07.681381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 203/405] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:07.687690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.697135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83b77-0635-4e08-bf8b-8d5d996249c7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.701342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.701926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.702209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.702516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.703348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:07.703645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.705459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.733236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 203/406] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:07.739636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.749022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f1b8-dc9d-4751-aa4a-7f39d1162586 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.753898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9be70-df80-4567-8975-02b002e2e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.754495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9be70-df80-4567-8975-02b002e2e745 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.755197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9be70-df80-4567-8975-02b002e2e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.755197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9be70-df80-4567-8975-02b002e2e745 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.762810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9be70-df80-4567-8975-02b002e2e745 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.764544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9be70-df80-4567-8975-02b002e2e745 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.773629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 204/407] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:41:07.779351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.789051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cc12-e574-497b-92ec-bdd2e45a567e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.793206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.794003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.794387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.794702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.806953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.808776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.826698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:07.827860 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 204/408] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:07.833415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9be70-df80-4567-8975-02b002e2e745 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.842170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9be70-df80-4567-8975-02b002e2e745 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.846248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.847016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.847303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.847585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.848270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:07.848570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.850144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.863138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 205/409] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:07.868588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.878561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6bcdf-47e8-4b80-b708-0e43bc1349f1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.882735 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.883449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.883740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.884022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.892439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.894372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.907942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:07.909048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 205/410] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:07.914973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.925091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bfb2c-6719-4fcd-8502-2a4de879894a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.929233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bb9a7-541b-4d12-ad89-21e6d5f3a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.929823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb9a7-541b-4d12-ad89-21e6d5f3a4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.930110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb9a7-541b-4d12-ad89-21e6d5f3a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.930390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb9a7-541b-4d12-ad89-21e6d5f3a4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.931157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bb9a7-541b-4d12-ad89-21e6d5f3a4e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:07.931458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bb9a7-541b-4d12-ad89-21e6d5f3a4e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.933307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bb9a7-541b-4d12-ad89-21e6d5f3a4e7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.946543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 206/411] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:07.952360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:07.963216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8465f9a-f9ed-44db-925b-9387064ebb62 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:07.967285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ebc5-5d2c-49ef-b081-c3fb5008cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:07.967866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ebc5-5d2c-49ef-b081-c3fb5008cef2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:07.968149 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ebc5-5d2c-49ef-b081-c3fb5008cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:07.968423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ebc5-5d2c-49ef-b081-c3fb5008cef2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:07.969204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ebc5-5d2c-49ef-b081-c3fb5008cef2 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=baae94f89c07491a875477ede4e06b57) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:07.969500 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ebc5-5d2c-49ef-b081-c3fb5008cef2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:07.971365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ebc5-5d2c-49ef-b081-c3fb5008cef2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:07.977966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 206/412] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:41:07 2021] GET /identity/v3/role_assignments?user.id=baae94f89c07491a875477ede4e06b57&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=98f77a1006404111a8be8686551c8675 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:10.036334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a917ae-f98f-446a-b566-eb952eafec03 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.036846 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a917ae-f98f-446a-b566-eb952eafec03 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.036934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a917ae-f98f-446a-b566-eb952eafec03 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.038588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 207/413] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:10.043755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7b66-2b90-4492-89c5-c9aaa8410546 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.044150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7b66-2b90-4492-89c5-c9aaa8410546 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.044326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7b66-2b90-4492-89c5-c9aaa8410546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.065962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-13dc7b66-2b90-4492-89c5-c9aaa8410546 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:10.067140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-13dc7b66-2b90-4492-89c5-c9aaa8410546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:10.073999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 207/414] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:10.096701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a917ae-f98f-446a-b566-eb952eafec03 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.108299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a917ae-f98f-446a-b566-eb952eafec03 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.112546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab1725-d70a-48a2-aa61-cb63c9ad2125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.113257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab1725-d70a-48a2-aa61-cb63c9ad2125 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.113543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab1725-d70a-48a2-aa61-cb63c9ad2125 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.113820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab1725-d70a-48a2-aa61-cb63c9ad2125 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.124647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab1725-d70a-48a2-aa61-cb63c9ad2125 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:10.131124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-f0ab1725-d70a-48a2-aa61-cb63c9ad2125 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:41:10.132192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 208/415] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:10.137780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7b66-2b90-4492-89c5-c9aaa8410546 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.146911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7b66-2b90-4492-89c5-c9aaa8410546 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.151043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.151632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.151922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.152208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.152919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:10.153218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.154863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.163798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 208/416] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:10.169315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab1725-d70a-48a2-aa61-cb63c9ad2125 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.179164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab1725-d70a-48a2-aa61-cb63c9ad2125 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.183172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.183881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.184168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.184446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.195432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.197210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.215319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:10.216517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 209/417] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:10.223119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.233019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd1795-3be4-4281-84c5-fad2a8a25274 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.237600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.238210 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.238536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.238821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.239533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:10.239836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.241443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.254980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 209/418] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:10.260609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.270687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddcd95-f738-434a-a734-7bac5cfe178f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.274746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.275460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.275744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.276018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.288503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.290535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.307998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:41:10.309086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 210/419] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:10.315324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.324788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896582e-a151-46c8-9da4-77796756fba7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.329365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.329951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.330237 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.330546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.331329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:10.331630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.333452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.361755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 210/420] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:10.367764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.377954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a37cd-2dd1-459e-b329-1f8191c9385d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.382081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.382842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.383134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.383418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.395970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.397847 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.414823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:10.415933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 211/421] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:41:10.421634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.430871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1e5e-e513-41cb-b806-835242bc8eb3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.434883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.435470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.435754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.436029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.436714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:10.437548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.439172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.451250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 211/422] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:10.457531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.466901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d492-9097-45cb-bb78-191eda12fb98 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.473191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.473914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.474198 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.474503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.483276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.485458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.498889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:10.500447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 212/423] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:10.506167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.516206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432a70d-c57b-4fe6-92fe-94e9a48eb94c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.520278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99e1d-3dfe-4e57-850c-086a34ddaf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.520857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99e1d-3dfe-4e57-850c-086a34ddaf55 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.521148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99e1d-3dfe-4e57-850c-086a34ddaf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.521431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99e1d-3dfe-4e57-850c-086a34ddaf55 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.522176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b99e1d-3dfe-4e57-850c-086a34ddaf55 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:10.522517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b99e1d-3dfe-4e57-850c-086a34ddaf55 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.524357 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b99e1d-3dfe-4e57-850c-086a34ddaf55 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.538358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 212/424] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:10.544256 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:10.553603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed92b44-f92a-41bb-9e9d-bfcf926e61ab admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:10.557554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf073be-f75e-4fe7-bfcd-8ab00df9558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:10.558427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf073be-f75e-4fe7-bfcd-8ab00df9558f admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:10.558669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf073be-f75e-4fe7-bfcd-8ab00df9558f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:10.558945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf073be-f75e-4fe7-bfcd-8ab00df9558f admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/baae94f89c07491a875477ede4e06b57/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:10.560685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf073be-f75e-4fe7-bfcd-8ab00df9558f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=baae94f89c07491a875477ede4e06b57, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:10.563824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf073be-f75e-4fe7-bfcd-8ab00df9558f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:10.577480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 213/425] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:41:10 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/baae94f89c07491a875477ede4e06b57/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:41:12.621767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17061-37f3-4f89-8396-a51da832ad35 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:12.622289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17061-37f3-4f89-8396-a51da832ad35 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:12.622392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17061-37f3-4f89-8396-a51da832ad35 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:12.624010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 213/426] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:12.629105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ae81-250b-49fc-9fd8-6a3252ced137 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:12.629537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ae81-250b-49fc-9fd8-6a3252ced137 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:12.629670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ae81-250b-49fc-9fd8-6a3252ced137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:12.657406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-9cc7ae81-250b-49fc-9fd8-6a3252ced137 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:12.658660 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9cc7ae81-250b-49fc-9fd8-6a3252ced137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:12.727039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 214/427] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:12.750499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf17061-37f3-4f89-8396-a51da832ad35 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:12.761926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf17061-37f3-4f89-8396-a51da832ad35 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:12.765748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca890c43-382c-4c20-b04d-dd3ebe72f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:12.766522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca890c43-382c-4c20-b04d-dd3ebe72f628 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:12.766810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca890c43-382c-4c20-b04d-dd3ebe72f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:12.767085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca890c43-382c-4c20-b04d-dd3ebe72f628 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:12.777807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca890c43-382c-4c20-b04d-dd3ebe72f628 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:12.784756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-ca890c43-382c-4c20-b04d-dd3ebe72f628 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:41:12.785843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 214/428] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:41:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:12.791664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ae81-250b-49fc-9fd8-6a3252ced137 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:12.801036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ae81-250b-49fc-9fd8-6a3252ced137 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:12.805145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:12.805740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:12.806026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:12.806305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:12.807048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:12.807349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:12.808937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:12.817392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 215/429] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:41:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:12.822872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca890c43-382c-4c20-b04d-dd3ebe72f628 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:12.833083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca890c43-382c-4c20-b04d-dd3ebe72f628 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:12.837535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:12.838273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:12.838591 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:12.838866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:12.851686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:12.853570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:12.872807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:12.873869 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 215/430] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:41:12.879714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:12.889037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2c1f-48ed-44fb-bfe6-4a73238226cc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:12.895532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:12.896122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:12.896405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:12.896678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:12.897369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:12.897662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:12.899264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:12.912599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 216/431] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:12.918226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:12.927710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de6305-d417-4880-a544-8c67396dffb6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:12.932035 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:12.932743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:12.933031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:12.933305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:12.945970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:12.947989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:12.966018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:41:12.967171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 216/432] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:41:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:12.973596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:12.982914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eb750-f682-4078-a2df-77e9fa81dff8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:12.987161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:12.987746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:12.988028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:12.988300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:12.989078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:12.989368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:12.991530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:13.021029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 217/433] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:41:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:13.026766 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:13.036638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850251d-eb4b-4687-87ba-d9cd5f2e2ae5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:13.040750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171b8d2-efce-4ddf-ab12-7eecc332e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:13.041318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b8d2-efce-4ddf-ab12-7eecc332e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:13.041717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b8d2-efce-4ddf-ab12-7eecc332e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:13.042005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b8d2-efce-4ddf-ab12-7eecc332e3d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:13.049985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171b8d2-efce-4ddf-ab12-7eecc332e3d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:13.051752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171b8d2-efce-4ddf-ab12-7eecc332e3d8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:13.060195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 217/434] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:41:13.066019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:13.075604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae473bb-f8a2-4b34-8bc0-2e9f732ae5e7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:13.080189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:13.080909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:13.081196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:13.081476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:13.092975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:13.095498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:13.112432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:13.113525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 218/435] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:41:13.119116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171b8d2-efce-4ddf-ab12-7eecc332e3d8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:13.127745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171b8d2-efce-4ddf-ab12-7eecc332e3d8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:13.131770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:13.132353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:13.132638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:13.132914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:13.133597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:13.133892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:13.135486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:13.148702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 218/436] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:13.154171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:13.164311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598456-c883-4798-be29-b37e26c113d1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:13.168503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:13.169219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:13.169508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:13.169792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:13.178350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:13.180323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:13.193924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:13.195079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 219/437] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:13.200755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:13.210492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa397acf-ac4b-45bc-b89e-76559146836c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:13.214504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda0ab4-5b29-4262-93eb-d6fb1fa120d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:13.215080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda0ab4-5b29-4262-93eb-d6fb1fa120d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:13.215363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda0ab4-5b29-4262-93eb-d6fb1fa120d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:13.215637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda0ab4-5b29-4262-93eb-d6fb1fa120d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:13.216375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda0ab4-5b29-4262-93eb-d6fb1fa120d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:13.216675 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda0ab4-5b29-4262-93eb-d6fb1fa120d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:13.219128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda0ab4-5b29-4262-93eb-d6fb1fa120d6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:13.232035 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 219/438] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:13.238129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:13.247444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a4116-a9f2-4832-a447-c2500663f186 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:13.252011 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb933264-2a88-44f3-a138-d6b93a83d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:13.252584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933264-2a88-44f3-a138-d6b93a83d2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:13.252871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933264-2a88-44f3-a138-d6b93a83d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:13.253149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933264-2a88-44f3-a138-d6b93a83d2a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:13.253918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb933264-2a88-44f3-a138-d6b93a83d2a9 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=baae94f89c07491a875477ede4e06b57) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:13.254217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb933264-2a88-44f3-a138-d6b93a83d2a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:13.256084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb933264-2a88-44f3-a138-d6b93a83d2a9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:13.261946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 220/439] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:41:13 2021] GET /identity/v3/role_assignments?user.id=baae94f89c07491a875477ede4e06b57&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=98f77a1006404111a8be8686551c8675 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:15.367289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d225-884b-4458-b063-8da3dca702ee None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:15.367847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d225-884b-4458-b063-8da3dca702ee None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:15.367847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d225-884b-4458-b063-8da3dca702ee None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:15.369489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 220/440] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:15.375186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951526-3570-49d9-9930-77af5c29f147 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:15.375604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951526-3570-49d9-9930-77af5c29f147 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:15.375747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951526-3570-49d9-9930-77af5c29f147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:15.397440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-33951526-3570-49d9-9930-77af5c29f147 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:15.398604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-33951526-3570-49d9-9930-77af5c29f147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:15.405428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 221/441] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:41:15.426862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19d225-884b-4458-b063-8da3dca702ee None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:15.438972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19d225-884b-4458-b063-8da3dca702ee None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:15.442890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:15.443609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:15.443894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:15.444171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:15.444787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:15.445767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:15.445767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:41:15.445767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:41:15.446661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:15.457856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 14:41:15.458935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 221/442] 10.222.0.57 () {56 vars in 1153 bytes} [Mon Oct 25 14:41:15 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:15.464572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33951526-3570-49d9-9930-77af5c29f147 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:15.473161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33951526-3570-49d9-9930-77af5c29f147 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:15.477215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a6a19-a9f1-48a4-a665-b0723709c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:15.477800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6a19-a9f1-48a4-a665-b0723709c425 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:15.478088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6a19-a9f1-48a4-a665-b0723709c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:15.478367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6a19-a9f1-48a4-a665-b0723709c425 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:15.479057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a6a19-a9f1-48a4-a665-b0723709c425 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:15.479352 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a6a19-a9f1-48a4-a665-b0723709c425 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:15.480337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-561a6a19-a9f1-48a4-a665-b0723709c425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:15.480337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:41:15.480337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:41:15.481208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a6a19-a9f1-48a4-a665-b0723709c425 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:15.485876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 222/443] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:41:15 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:15.490995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:15.500767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e384-19be-444a-a98b-ce93d86508af admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:15.504733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee39d54-9d20-4880-b33c-d8bc30f4d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:15.505298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39d54-9d20-4880-b33c-d8bc30f4d215 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:15.505581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39d54-9d20-4880-b33c-d8bc30f4d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:15.505858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39d54-9d20-4880-b33c-d8bc30f4d215 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:15.506566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee39d54-9d20-4880-b33c-d8bc30f4d215 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:15.506864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee39d54-9d20-4880-b33c-d8bc30f4d215 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:15.507840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-fee39d54-9d20-4880-b33c-d8bc30f4d215 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:15.507840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:41:15.507840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:41:15.508710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee39d54-9d20-4880-b33c-d8bc30f4d215 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:15.513028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 222/444] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:41:15 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:17.594917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb5240-a1d8-4a85-a5d5-7d13e73d13b1 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:17.595460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb5240-a1d8-4a85-a5d5-7d13e73d13b1 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:17.595460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb5240-a1d8-4a85-a5d5-7d13e73d13b1 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:17.597147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 223/445] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:17.602348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd21e-ccad-4b9c-976f-d521d3715bc0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:17.602770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd21e-ccad-4b9c-976f-d521d3715bc0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:17.602943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd21e-ccad-4b9c-976f-d521d3715bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:17.624598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e35fd21e-ccad-4b9c-976f-d521d3715bc0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:17.625719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e35fd21e-ccad-4b9c-976f-d521d3715bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:17.632320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 223/446] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:41:17.655052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb5240-a1d8-4a85-a5d5-7d13e73d13b1 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:17.667846 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb5240-a1d8-4a85-a5d5-7d13e73d13b1 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:17.672373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4201150-1616-4a06-bc08-1d33148557f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:17.672958 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4201150-1616-4a06-bc08-1d33148557f6 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:17.673243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4201150-1616-4a06-bc08-1d33148557f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:17.673528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4201150-1616-4a06-bc08-1d33148557f6 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:17.674346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4201150-1616-4a06-bc08-1d33148557f6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:17.675459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-f4201150-1616-4a06-bc08-1d33148557f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:17.675459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:41:17.675459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:41:17.676508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4201150-1616-4a06-bc08-1d33148557f6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:17.689555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 224/447] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:41:17 2021] POST /identity/v3/services => generated 269 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:41:19.759817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3e6d8-c5db-42e2-abd9-aa03e1574dbf None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:19.760374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3e6d8-c5db-42e2-abd9-aa03e1574dbf None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:19.760374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3e6d8-c5db-42e2-abd9-aa03e1574dbf None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:19.762028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 224/448] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:19.767300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad83b6-5363-4119-9d65-59eed57ad4bb None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:19.767737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad83b6-5363-4119-9d65-59eed57ad4bb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:19.767843 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad83b6-5363-4119-9d65-59eed57ad4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:19.789237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-85ad83b6-5363-4119-9d65-59eed57ad4bb None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:19.790356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-85ad83b6-5363-4119-9d65-59eed57ad4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:19.807410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 225/449] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:19 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:19.829860 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3e6d8-c5db-42e2-abd9-aa03e1574dbf None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:19.841317 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3e6d8-c5db-42e2-abd9-aa03e1574dbf None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:19.845161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:19.845877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:19.846158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:19.846457 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:19.847077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:19.848628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:19.859933 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 14:41:19.860989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 225/450] 10.222.0.57 () {56 vars in 1153 bytes} [Mon Oct 25 14:41:19 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:19.866702 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad83b6-5363-4119-9d65-59eed57ad4bb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:19.875871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad83b6-5363-4119-9d65-59eed57ad4bb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:19.879922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:19.880503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:19.880787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:19.881065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:19.881723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:19.882017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:19.883621 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:19.887769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 226/451] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:41:19 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:19.892994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:19.902058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d8914-181c-4272-b4ae-aebfe8fcb850 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:19.906074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:19.906667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:19.906951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:19.907227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:19.907891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:19.908185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:19.909725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:19.914225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 226/452] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:41:19 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:19.919723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:19.929438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6c2cc-ae04-46f9-9ccd-98f178299564 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:19.933514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f106db-9b37-4f2b-bdee-61b670183a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:19.934092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f106db-9b37-4f2b-bdee-61b670183a0f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:19.934383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f106db-9b37-4f2b-bdee-61b670183a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:19.934699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f106db-9b37-4f2b-bdee-61b670183a0f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:19.935445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f106db-9b37-4f2b-bdee-61b670183a0f admin admin] RBAC: Adding query filter params (interface=public, service_id=28a7e928dcd34a76b1063d934691a090, region_id=RegionOne) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:19.935749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f106db-9b37-4f2b-bdee-61b670183a0f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:19.937281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-96f106db-9b37-4f2b-bdee-61b670183a0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:19.937281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:41:19.937281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:41:19.938157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f106db-9b37-4f2b-bdee-61b670183a0f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:19.943901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 227/453] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:41:19 2021] GET /identity/v3/endpoints?service_id=28a7e928dcd34a76b1063d934691a090&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:19.949138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:19.958442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491241c-c89d-4655-b7ef-958e42247231 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:19.963062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3451d-19c2-4545-99cb-f247a6e39cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:19.963638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3451d-19c2-4545-99cb-f247a6e39cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:19.963922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3451d-19c2-4545-99cb-f247a6e39cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:19.964200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3451d-19c2-4545-99cb-f247a6e39cc3 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:19.964847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3451d-19c2-4545-99cb-f247a6e39cc3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:19.966424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3451d-19c2-4545-99cb-f247a6e39cc3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:19.971182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 227/454] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:41:19 2021] GET /identity/v3/services => generated 562 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:22.054993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e983b00-cfd6-4957-b1d5-77e18c577f6c None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:22.055547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e983b00-cfd6-4957-b1d5-77e18c577f6c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:22.055547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e983b00-cfd6-4957-b1d5-77e18c577f6c None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:22.057213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 228/455] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:22.062385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49da5-a7b7-44c2-a174-e47b983ba576 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:22.062792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49da5-a7b7-44c2-a174-e47b983ba576 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:22.062966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49da5-a7b7-44c2-a174-e47b983ba576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:22.084874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-fee49da5-a7b7-44c2-a174-e47b983ba576 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:22.085927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fee49da5-a7b7-44c2-a174-e47b983ba576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:22.092623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 228/456] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:22 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:22.115158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e983b00-cfd6-4957-b1d5-77e18c577f6c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:22.126764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e983b00-cfd6-4957-b1d5-77e18c577f6c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:22.130700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:22.131430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:22.131717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:22.131997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:22.132610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:22.133601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:22.133601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:41:22.133601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:41:22.134499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:22.146370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 14:41:22.147441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 229/457] 10.222.0.57 () {56 vars in 1153 bytes} [Mon Oct 25 14:41:22 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:22.153261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee49da5-a7b7-44c2-a174-e47b983ba576 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:22.162395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee49da5-a7b7-44c2-a174-e47b983ba576 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:22.166454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:22.167030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:22.167314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:22.167592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:22.168259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:22.168554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:22.170114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:22.174233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 229/458] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:41:22 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:22.179533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:22.188763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00172f6e-7ecf-441e-b710-91e3af83dbca admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:22.192867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeb267-9a39-4f4a-ad0f-13170ded2d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:22.193443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeb267-9a39-4f4a-ad0f-13170ded2d59 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:22.193729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeb267-9a39-4f4a-ad0f-13170ded2d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:22.194009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeb267-9a39-4f4a-ad0f-13170ded2d59 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:22.194713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeb267-9a39-4f4a-ad0f-13170ded2d59 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:22.195011 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeb267-9a39-4f4a-ad0f-13170ded2d59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:22.196595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeb267-9a39-4f4a-ad0f-13170ded2d59 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:22.201218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 230/459] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:41:22 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:22.207040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:22.216033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcd7ed-a424-4e83-b612-c749c99ae031 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:22.220641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6dd75-189e-4b39-9878-dcd78f2fe641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:22.221201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dd75-189e-4b39-9878-dcd78f2fe641 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:22.221484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dd75-189e-4b39-9878-dcd78f2fe641 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:22.221759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dd75-189e-4b39-9878-dcd78f2fe641 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:22.222473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6dd75-189e-4b39-9878-dcd78f2fe641 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:22.223447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-e2c6dd75-189e-4b39-9878-dcd78f2fe641 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:22.223447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:41:22.223447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:41:22.224308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6dd75-189e-4b39-9878-dcd78f2fe641 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:22.243228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 230/460] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:41:22 2021] POST /identity/v3/endpoints => generated 347 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:41:24.325829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a94cd-af15-4125-8d5a-56f81910a2f4 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:24.326384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a94cd-af15-4125-8d5a-56f81910a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:24.326384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a94cd-af15-4125-8d5a-56f81910a2f4 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:24.328580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 231/461] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:24.333736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511402b-1234-4e56-bf61-a8c3158384f1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:24.334161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511402b-1234-4e56-bf61-a8c3158384f1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:24.334303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511402b-1234-4e56-bf61-a8c3158384f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:24.356450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4511402b-1234-4e56-bf61-a8c3158384f1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:24.357584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4511402b-1234-4e56-bf61-a8c3158384f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:24.377885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 231/462] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:24 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:41:24.399655 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a94cd-af15-4125-8d5a-56f81910a2f4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:24.411766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a94cd-af15-4125-8d5a-56f81910a2f4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:24.415639 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:24.416342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:24.416623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:24.416897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:24.417524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:24.419139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:24.429356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 14:41:24.430432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 232/463] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:24 2021] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:24.436100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511402b-1234-4e56-bf61-a8c3158384f1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:24.445072 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511402b-1234-4e56-bf61-a8c3158384f1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:24.449200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e941716-012b-4820-b852-8f8f960f99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:24.449784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941716-012b-4820-b852-8f8f960f99ca admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:24.450076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941716-012b-4820-b852-8f8f960f99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:24.450359 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941716-012b-4820-b852-8f8f960f99ca admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:24.451079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e941716-012b-4820-b852-8f8f960f99ca admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:24.451379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e941716-012b-4820-b852-8f8f960f99ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:24.453474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e941716-012b-4820-b852-8f8f960f99ca admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:24.457666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 232/464] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:41:24 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:24.462967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:24.473389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47830a-cc66-4654-be94-607d0d2188d0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:24.477377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717cd9b-8a4f-4b19-a600-bd6a15436a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:24.477945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cd9b-8a4f-4b19-a600-bd6a15436a74 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:24.478227 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cd9b-8a4f-4b19-a600-bd6a15436a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:24.478540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cd9b-8a4f-4b19-a600-bd6a15436a74 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:24.479196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717cd9b-8a4f-4b19-a600-bd6a15436a74 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:24.479490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717cd9b-8a4f-4b19-a600-bd6a15436a74 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:24.481051 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717cd9b-8a4f-4b19-a600-bd6a15436a74 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:24.485619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 233/465] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:41:24 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:26.554888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7540872-3a73-44f0-902d-09ee419a8164 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:26.555418 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7540872-3a73-44f0-902d-09ee419a8164 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:26.555507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7540872-3a73-44f0-902d-09ee419a8164 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:26.557114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 233/466] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:26.562936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aab6a-0601-46dd-893b-0cf18a9ea0fc None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:26.563364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aab6a-0601-46dd-893b-0cf18a9ea0fc None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:26.563489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aab6a-0601-46dd-893b-0cf18a9ea0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:26.585303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-049aab6a-0601-46dd-893b-0cf18a9ea0fc None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:26.586478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-049aab6a-0601-46dd-893b-0cf18a9ea0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:26.593397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 234/467] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:26 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:26.615841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7540872-3a73-44f0-902d-09ee419a8164 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:26.627996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7540872-3a73-44f0-902d-09ee419a8164 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:26.631930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dbe17-3c5d-4b87-a703-b4e0ca3d62ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:26.632500 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dbe17-3c5d-4b87-a703-b4e0ca3d62ae admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:26.632786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dbe17-3c5d-4b87-a703-b4e0ca3d62ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:26.633068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dbe17-3c5d-4b87-a703-b4e0ca3d62ae admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:26.633742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dbe17-3c5d-4b87-a703-b4e0ca3d62ae admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:26.634770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-1c3dbe17-3c5d-4b87-a703-b4e0ca3d62ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:26.634770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:41:26.634770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:41:26.635648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dbe17-3c5d-4b87-a703-b4e0ca3d62ae admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:26.648487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 234/468] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:41:26 2021] POST /identity/v3/services => generated 242 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:41:28.740343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1d7a4-2c28-409e-a7b5-9a8f9eb445ad None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:28.740874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1d7a4-2c28-409e-a7b5-9a8f9eb445ad None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:28.740988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1d7a4-2c28-409e-a7b5-9a8f9eb445ad None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:28.742639 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 235/469] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:28.747740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39513d8-8b7b-4020-bfe8-017a51c95530 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:28.748161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39513d8-8b7b-4020-bfe8-017a51c95530 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:28.748304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39513d8-8b7b-4020-bfe8-017a51c95530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:28.770324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c39513d8-8b7b-4020-bfe8-017a51c95530 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:28.771498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c39513d8-8b7b-4020-bfe8-017a51c95530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:28.787990 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 235/470] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:28 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:28.809788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1d7a4-2c28-409e-a7b5-9a8f9eb445ad None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:28.825435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1d7a4-2c28-409e-a7b5-9a8f9eb445ad None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:28.833809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:28.834588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:28.834879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:28.835163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:28.835789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:28.837379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:28.848908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 14:41:28.849982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 236/471] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:28.855824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39513d8-8b7b-4020-bfe8-017a51c95530 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:28.865915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39513d8-8b7b-4020-bfe8-017a51c95530 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:28.870695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:28.871280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:28.871566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:28.871847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:28.872525 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:28.872831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:28.874448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:28.878758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 236/472] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:41:28 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:28.884119 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:28.893879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32a8c9-32f5-419b-8dea-0da5053fe4c1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:28.897912 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:28.898523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:28.898813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:28.899096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:28.899762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:28.900057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:28.901627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:28.906784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 237/473] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:41:28 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:28.912336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:28.921532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bafc9c-6fb4-4ab0-9fef-c3e9d438dc78 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:28.925542 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f503ce-2b31-4a53-aaa8-83b5576e5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:28.926116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f503ce-2b31-4a53-aaa8-83b5576e5b52 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:28.926427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f503ce-2b31-4a53-aaa8-83b5576e5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:28.926707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f503ce-2b31-4a53-aaa8-83b5576e5b52 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:28.927452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f503ce-2b31-4a53-aaa8-83b5576e5b52 admin admin] RBAC: Adding query filter params (interface=public, service_id=9a542de1de344ffb9c64d326ef9eb869, region_id=RegionOne) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:28.927756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f503ce-2b31-4a53-aaa8-83b5576e5b52 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:28.928742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-b9f503ce-2b31-4a53-aaa8-83b5576e5b52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:28.928742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:41:28.928742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:41:28.929615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f503ce-2b31-4a53-aaa8-83b5576e5b52 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:28.935333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 237/474] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:41:28 2021] GET /identity/v3/endpoints?service_id=9a542de1de344ffb9c64d326ef9eb869&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:28.940732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:28.949921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddaf5d-5673-4f53-9a84-004141627764 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:28.954656 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63ad0f-a166-4336-8818-5eff33f547df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:28.955261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ad0f-a166-4336-8818-5eff33f547df admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:28.955548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ad0f-a166-4336-8818-5eff33f547df admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:28.955828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ad0f-a166-4336-8818-5eff33f547df admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:28.956501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63ad0f-a166-4336-8818-5eff33f547df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:28.958140 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63ad0f-a166-4336-8818-5eff33f547df admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:28.963863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 238/475] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:41:28 2021] GET /identity/v3/services => generated 792 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:31.050369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ae335-b9a6-4061-aa3c-8eccb69c7648 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:31.050917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ae335-b9a6-4061-aa3c-8eccb69c7648 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:31.051004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ae335-b9a6-4061-aa3c-8eccb69c7648 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:31.052625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 238/476] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:31.057786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13daf1-f982-4e07-8c6a-c4f392723790 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:31.058179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13daf1-f982-4e07-8c6a-c4f392723790 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:31.058341 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13daf1-f982-4e07-8c6a-c4f392723790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:31.084589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5c13daf1-f982-4e07-8c6a-c4f392723790 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:31.085646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5c13daf1-f982-4e07-8c6a-c4f392723790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:31.092396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 239/477] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:31 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:31.114652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ae335-b9a6-4061-aa3c-8eccb69c7648 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:31.126887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ae335-b9a6-4061-aa3c-8eccb69c7648 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:31.130852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:31.131559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:31.131846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:31.132124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:31.132745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:31.134343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:31.144565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 14:41:31.145626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 239/478] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:31 2021] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:31.151447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13daf1-f982-4e07-8c6a-c4f392723790 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:31.159926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13daf1-f982-4e07-8c6a-c4f392723790 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:31.164004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:31.164580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:31.164861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:31.165136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:31.165791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:31.166086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:31.167689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:31.172499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 240/479] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:41:31 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:31.177926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:31.187740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557295e-e09e-4185-b810-bc101e02a2ba admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:31.191721 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee824b-21fe-4652-bdcc-3f8e85157146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:31.192321 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee824b-21fe-4652-bdcc-3f8e85157146 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:31.192606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee824b-21fe-4652-bdcc-3f8e85157146 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:31.192885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee824b-21fe-4652-bdcc-3f8e85157146 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:31.193552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee824b-21fe-4652-bdcc-3f8e85157146 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:31.193851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee824b-21fe-4652-bdcc-3f8e85157146 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:31.195566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee824b-21fe-4652-bdcc-3f8e85157146 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:31.200091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 240/480] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:41:31 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:31.205439 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:31.214544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2061192-4758-43c7-83c6-1e2f6df94f15 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:31.218540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cda53-7c48-4483-af9e-8aad4b51a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:31.219109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cda53-7c48-4483-af9e-8aad4b51a19f admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:31.219389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cda53-7c48-4483-af9e-8aad4b51a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:31.219661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cda53-7c48-4483-af9e-8aad4b51a19f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:31.220344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cda53-7c48-4483-af9e-8aad4b51a19f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:31.221331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-c70cda53-7c48-4483-af9e-8aad4b51a19f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:41:31.221331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:41:31.221331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:41:31.222183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cda53-7c48-4483-af9e-8aad4b51a19f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:31.241216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 241/481] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:41:31 2021] POST /identity/v3/endpoints => generated 334 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:41:33.377380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae120-c6cf-4426-906b-f0146f74bd38 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.377965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae120-c6cf-4426-906b-f0146f74bd38 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.377965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae120-c6cf-4426-906b-f0146f74bd38 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.379602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 241/482] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:33.384689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49f01d-37c1-40dd-b286-81176493576a None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.385089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49f01d-37c1-40dd-b286-81176493576a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.385248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49f01d-37c1-40dd-b286-81176493576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.406800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1c49f01d-37c1-40dd-b286-81176493576a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:33.407925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1c49f01d-37c1-40dd-b286-81176493576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:33.424107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 242/483] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:33 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:33.448532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdae120-c6cf-4426-906b-f0146f74bd38 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.459884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdae120-c6cf-4426-906b-f0146f74bd38 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.463777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048cd24-48da-421a-9687-8bc1afe1e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.464492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048cd24-48da-421a-9687-8bc1afe1e20f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.464774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048cd24-48da-421a-9687-8bc1afe1e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.465045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048cd24-48da-421a-9687-8bc1afe1e20f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.476217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048cd24-48da-421a-9687-8bc1afe1e20f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:33.483488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-3048cd24-48da-421a-9687-8bc1afe1e20f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 14:41:33.484811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 242/484] 10.222.0.57 () {56 vars in 1141 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:33.490539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49f01d-37c1-40dd-b286-81176493576a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.499916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49f01d-37c1-40dd-b286-81176493576a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.504052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.504643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.504929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.505207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.505908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:33.506206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.507840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.515916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 243/485] 10.222.0.57 () {56 vars in 1136 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:33.521430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048cd24-48da-421a-9687-8bc1afe1e20f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.531215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048cd24-48da-421a-9687-8bc1afe1e20f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.535234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.535954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.536227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.536506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.548685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.550541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.567033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:33.568107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 243/486] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:33.573686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.582929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6256c11-1b01-454d-9118-2f964b8fc40a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.586928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.587506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.587794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.588071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.588751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:33.589045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.590650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.604531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 244/487] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:33.610951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.620433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa715-9d99-48c0-8387-51ff715065e1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.624900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.625642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.625928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.626206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.641674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.643703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.663132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:41:33.664277 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 244/488] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:33.670026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.680291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d51bc-b9c4-4f2b-a11d-dada560285d1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.684326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.684919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.685201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.685474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.686248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:33.686571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.688381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.716118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 245/489] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:33.722232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.731626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c38b5-8eda-4e0c-8e35-47d9b8b8edd0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.736581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b34064-6a82-4511-8015-8e36404ed6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.737147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b34064-6a82-4511-8015-8e36404ed6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.737431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b34064-6a82-4511-8015-8e36404ed6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.737709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b34064-6a82-4511-8015-8e36404ed6a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.745581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b34064-6a82-4511-8015-8e36404ed6a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.747358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b34064-6a82-4511-8015-8e36404ed6a3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.756460 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 245/490] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:41:33.762214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.771766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29ce5-6531-4857-8368-4f3c361b86d2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.775891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.776603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.776892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.777172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.789529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.791505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.809063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:33.810189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 246/491] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:33.815852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b34064-6a82-4511-8015-8e36404ed6a3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.824635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b34064-6a82-4511-8015-8e36404ed6a3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.828859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.829442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.829726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.830004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.830730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:33.831027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.832598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.845640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 246/492] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:33.851322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.861662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c427e17-e105-4c5c-9af4-2bf29107277b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.865691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.866445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.866714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.866992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.875631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.877567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.891921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:33.892953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 247/493] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:33.898886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.908999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7af44-9c54-474f-8b6b-a1da5817d9cc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.913145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaf2b1-28b2-41f6-97ad-35997e72e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.913732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf2b1-28b2-41f6-97ad-35997e72e67b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.914021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf2b1-28b2-41f6-97ad-35997e72e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.914302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf2b1-28b2-41f6-97ad-35997e72e67b admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.915087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaf2b1-28b2-41f6-97ad-35997e72e67b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:33.915389 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaf2b1-28b2-41f6-97ad-35997e72e67b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.917215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaf2b1-28b2-41f6-97ad-35997e72e67b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.930116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 247/494] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:33.936270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:33.945654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c717ba5-eb2b-4064-a5e3-eea354684589 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:33.949686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75012e2f-6390-494b-a1d3-f4db1086f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:33.950269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012e2f-6390-494b-a1d3-f4db1086f6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:33.950590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012e2f-6390-494b-a1d3-f4db1086f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:33.950876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012e2f-6390-494b-a1d3-f4db1086f6c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:33.952154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75012e2f-6390-494b-a1d3-f4db1086f6c6 admin admin] RBAC: Adding query filter params (role.id=4a58aa8728584976ad1c9875ab382bb4, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=baae94f89c07491a875477ede4e06b57) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:33.952457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75012e2f-6390-494b-a1d3-f4db1086f6c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:33.954289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75012e2f-6390-494b-a1d3-f4db1086f6c6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:33.959815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 248/495] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:41:33 2021] GET /identity/v3/role_assignments?user.id=baae94f89c07491a875477ede4e06b57&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=4a58aa8728584976ad1c9875ab382bb4 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:36.044533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dedb-786c-4c21-9507-efc1461638d8 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.045076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dedb-786c-4c21-9507-efc1461638d8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.045076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dedb-786c-4c21-9507-efc1461638d8 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.046881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 248/496] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:36.052049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbfc6b-db55-4628-97ee-4fb9056fcc41 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.052448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbfc6b-db55-4628-97ee-4fb9056fcc41 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.052600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbfc6b-db55-4628-97ee-4fb9056fcc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.074766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-67bbfc6b-db55-4628-97ee-4fb9056fcc41 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:36.075835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-67bbfc6b-db55-4628-97ee-4fb9056fcc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:36.083313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 249/497] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:36 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:36.105301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990dedb-786c-4c21-9507-efc1461638d8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.117226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990dedb-786c-4c21-9507-efc1461638d8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.121170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00775cd-2323-4b86-ba1b-320bb56d9f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.121893 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00775cd-2323-4b86-ba1b-320bb56d9f6a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.122180 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00775cd-2323-4b86-ba1b-320bb56d9f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.122494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00775cd-2323-4b86-ba1b-320bb56d9f6a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.133828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00775cd-2323-4b86-ba1b-320bb56d9f6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:36.141309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-b00775cd-2323-4b86-ba1b-320bb56d9f6a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 14:41:36.142380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 249/498] 10.222.0.57 () {56 vars in 1141 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:36.148130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbfc6b-db55-4628-97ee-4fb9056fcc41 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.156665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbfc6b-db55-4628-97ee-4fb9056fcc41 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.160694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.161343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.161627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.161901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.162637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:36.162929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.164495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.173056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 250/499] 10.222.0.57 () {56 vars in 1136 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:36.178384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00775cd-2323-4b86-ba1b-320bb56d9f6a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.188624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00775cd-2323-4b86-ba1b-320bb56d9f6a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.192748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.193511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.193799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.194078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.205192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.207094 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.223841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:36.224950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 250/500] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:36.230506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.240420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443182a-f522-4112-8050-2e1c1e34d7fe admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.244611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.245189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.245474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.245752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.246446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:36.246743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.250225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.262691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 251/501] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:36.268725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.278011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ee0dc-434d-4319-94a2-e6b3887824a6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.282747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.283453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.283740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.284014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.296347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.298347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.315559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:41:36.316639 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 251/502] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:36.322372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.332980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107542d9-9dff-4d6a-bfd2-f97597bf5ca0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.337382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.338006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.338295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.338687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.339491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:36.339795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.341685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.372505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 252/503] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:36.378068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.389570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faaaa7-4abb-494c-844c-6cda57e8e1ab admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.393625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.394333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.394648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.394926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.407150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.408968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.425473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:36.426601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 252/504] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:36.432241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.441863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febee396-b2fc-44e5-9542-365d8337209e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.445982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.446593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.446882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.447165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.447851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:36.448154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.449733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.462177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 253/505] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:36.468264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.477589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851b1f4-7346-4b00-81d8-482b6850fcf6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.481660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.482371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.482690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.482966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.491645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.493597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.507656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:36.508781 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 253/506] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:36.515203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.524674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac10f4-d682-4d40-8f47-0805a38d54b6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.528809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b777bb8-b7dc-4f0f-8e23-6d62391ac024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.529392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b777bb8-b7dc-4f0f-8e23-6d62391ac024 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.529682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b777bb8-b7dc-4f0f-8e23-6d62391ac024 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.529963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b777bb8-b7dc-4f0f-8e23-6d62391ac024 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.530741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b777bb8-b7dc-4f0f-8e23-6d62391ac024 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:36.531043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b777bb8-b7dc-4f0f-8e23-6d62391ac024 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.532876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b777bb8-b7dc-4f0f-8e23-6d62391ac024 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.545440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 254/507] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:36.551447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:36.561327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c6a24-e5d6-4615-b96f-d4e431cb9fab admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:36.565567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67700d06-d96a-40b7-ab57-a13a4ba9ee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:36.566377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700d06-d96a-40b7-ab57-a13a4ba9ee89 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:36.566695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700d06-d96a-40b7-ab57-a13a4ba9ee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:36.566980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700d06-d96a-40b7-ab57-a13a4ba9ee89 admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/baae94f89c07491a875477ede4e06b57/roles/4a58aa8728584976ad1c9875ab382bb4` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:36.569005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67700d06-d96a-40b7-ab57-a13a4ba9ee89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=baae94f89c07491a875477ede4e06b57, role_id=4a58aa8728584976ad1c9875ab382bb4)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:36.571675 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67700d06-d96a-40b7-ab57-a13a4ba9ee89 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:36.586068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 254/508] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:41:36 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/baae94f89c07491a875477ede4e06b57/roles/4a58aa8728584976ad1c9875ab382bb4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:41:38.633890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba923-ad68-4239-82d1-b13d57ff95bb None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:38.634486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba923-ad68-4239-82d1-b13d57ff95bb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:38.634486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba923-ad68-4239-82d1-b13d57ff95bb None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:38.636186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 255/509] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:38.641506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd318-1f18-4ef0-a6cf-6fe75f2d86e7 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:38.641935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd318-1f18-4ef0-a6cf-6fe75f2d86e7 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:38.642070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd318-1f18-4ef0-a6cf-6fe75f2d86e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:38.663794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-352bd318-1f18-4ef0-a6cf-6fe75f2d86e7 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:38.664943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-352bd318-1f18-4ef0-a6cf-6fe75f2d86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:38.727031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 255/510] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:38 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:38.750636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba923-ad68-4239-82d1-b13d57ff95bb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:38.762274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba923-ad68-4239-82d1-b13d57ff95bb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:38.766275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398b7a-f001-47fe-af77-5e03ef0c87f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:38.767031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398b7a-f001-47fe-af77-5e03ef0c87f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:38.767318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398b7a-f001-47fe-af77-5e03ef0c87f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:38.767595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398b7a-f001-47fe-af77-5e03ef0c87f7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:38.778427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398b7a-f001-47fe-af77-5e03ef0c87f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:38.785975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-95398b7a-f001-47fe-af77-5e03ef0c87f7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 14:41:38.787289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 256/511] 10.222.0.57 () {56 vars in 1141 bytes} [Mon Oct 25 14:41:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:38.792882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd318-1f18-4ef0-a6cf-6fe75f2d86e7 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:38.802349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd318-1f18-4ef0-a6cf-6fe75f2d86e7 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:38.806571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:38.807166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:38.807455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:38.807736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:38.808458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:38.808759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:38.810365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:38.818923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 256/512] 10.222.0.57 () {56 vars in 1136 bytes} [Mon Oct 25 14:41:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:38.824404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398b7a-f001-47fe-af77-5e03ef0c87f7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:38.834431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398b7a-f001-47fe-af77-5e03ef0c87f7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:38.838544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:38.839256 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:38.839541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:38.839844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:38.851412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:38.853248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:38.873404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:38.874542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 257/513] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:38.880295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:38.889724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8660-ef42-43f8-a2a6-9aeba37f5dc3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:38.893814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:38.894444 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:38.894733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:38.895012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:38.895699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:38.895997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:38.897557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:38.910287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 257/514] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:38.915694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:38.925455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50b28-ae7f-4fec-bc92-d86233a4ba6e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:38.929508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:38.930222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:38.930607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:38.930889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:38.946018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:38.948108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:38.967695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 14:41:38.968876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 258/515] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 25 14:41:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:38.974560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:38.984993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb7d7-fb3c-4061-9ecf-694cc6c27d0c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:38.989217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:38.989811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:38.990100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:38.990381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:38.991202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:38.991505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:38.993342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:39.114917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 258/516] 10.222.0.57 () {56 vars in 1154 bytes} [Mon Oct 25 14:41:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:39.120498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:39.129784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234b40-c1bb-4db5-9621-035097849a2b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:39.133874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05495b5-7d23-4257-be7a-0a97cd26212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:39.134465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05495b5-7d23-4257-be7a-0a97cd26212c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:39.134749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05495b5-7d23-4257-be7a-0a97cd26212c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:39.135024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05495b5-7d23-4257-be7a-0a97cd26212c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:39.143321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05495b5-7d23-4257-be7a-0a97cd26212c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:39.144990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05495b5-7d23-4257-be7a-0a97cd26212c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:39.153465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 259/517] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:39 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:41:39.160041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:39.169486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010f89c-9ec5-4186-a87f-5a4203e82211 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:39.173527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:39.174242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:39.174554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:39.174829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:39.186349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:39.188170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:39.205111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:39.206204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 259/518] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:39.211808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05495b5-7d23-4257-be7a-0a97cd26212c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:39.220866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05495b5-7d23-4257-be7a-0a97cd26212c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:39.224929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:39.225504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:39.225793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:39.226064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:39.226763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:39.227056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:39.228615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:39.241356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 260/519] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:39.247145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:39.256684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014669-2330-4053-8533-e2c8b3b5dd5b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:39.260805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:39.261519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:39.261810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:39.262091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:39.271124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:39.273063 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:39.287233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:39.288334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 260/520] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:39.294162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:39.303761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8bcb-3eb0-4990-b0e1-2cb31cde5903 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:39.307896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48d547-143a-4208-9dd3-d06003d10a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:39.308482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48d547-143a-4208-9dd3-d06003d10a43 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:39.308767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48d547-143a-4208-9dd3-d06003d10a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:39.309045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48d547-143a-4208-9dd3-d06003d10a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:39.309783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48d547-143a-4208-9dd3-d06003d10a43 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:39.310083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48d547-143a-4208-9dd3-d06003d10a43 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:39.312115 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48d547-143a-4208-9dd3-d06003d10a43 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:39.324824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 261/521] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:39.331342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:39.340719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870c015-548f-489e-882d-2cc09431b6d5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:39.345240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2841249-d369-4400-968c-7ee4a8c3066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:39.345803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2841249-d369-4400-968c-7ee4a8c3066d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:39.346085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2841249-d369-4400-968c-7ee4a8c3066d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:39.346360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2841249-d369-4400-968c-7ee4a8c3066d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:39.347160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2841249-d369-4400-968c-7ee4a8c3066d admin admin] RBAC: Adding query filter params (role.id=4a58aa8728584976ad1c9875ab382bb4, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=baae94f89c07491a875477ede4e06b57) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:39.347458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2841249-d369-4400-968c-7ee4a8c3066d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:39.349264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2841249-d369-4400-968c-7ee4a8c3066d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:39.354933 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 261/522] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:41:39 2021] GET /identity/v3/role_assignments?user.id=baae94f89c07491a875477ede4e06b57&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=4a58aa8728584976ad1c9875ab382bb4 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:41.641460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046d1d-e196-4d64-80cf-811bc458c953 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:41.641988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046d1d-e196-4d64-80cf-811bc458c953 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:41.642091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046d1d-e196-4d64-80cf-811bc458c953 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:41.643706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 262/523] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:41.648875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031c7b6-c519-4b4a-8959-1adcb5c6a3ea None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:41.649323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031c7b6-c519-4b4a-8959-1adcb5c6a3ea None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:41.649452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031c7b6-c519-4b4a-8959-1adcb5c6a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:41.671738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a031c7b6-c519-4b4a-8959-1adcb5c6a3ea None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:41.672879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a031c7b6-c519-4b4a-8959-1adcb5c6a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:41.679756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 262/524] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:41 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:41.703809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046d1d-e196-4d64-80cf-811bc458c953 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:41.715413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046d1d-e196-4d64-80cf-811bc458c953 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:41.719398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:41.720107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:41.720393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:41.720673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:41.731817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:41.734361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:41.751429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:41.752501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 263/525] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:41.758434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031c7b6-c519-4b4a-8959-1adcb5c6a3ea None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:41.767147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031c7b6-c519-4b4a-8959-1adcb5c6a3ea None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:41.771274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a224ed3-cd10-4407-bf17-efd9a1113f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:41.771854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224ed3-cd10-4407-bf17-efd9a1113f7f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:41.772142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224ed3-cd10-4407-bf17-efd9a1113f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:41.772422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224ed3-cd10-4407-bf17-efd9a1113f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:41.773109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a224ed3-cd10-4407-bf17-efd9a1113f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:41.773409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a224ed3-cd10-4407-bf17-efd9a1113f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:41.775053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a224ed3-cd10-4407-bf17-efd9a1113f7f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:41.787850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 263/526] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:41.793409 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:41.803322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe2d9-aa98-48d1-8535-e9f5d61d2ee2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:41.807343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6114f-aaf2-4b70-9209-38d4894b5a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:41.807929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6114f-aaf2-4b70-9209-38d4894b5a11 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:41.808214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6114f-aaf2-4b70-9209-38d4894b5a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:41.808491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6114f-aaf2-4b70-9209-38d4894b5a11 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:41.809220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6114f-aaf2-4b70-9209-38d4894b5a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:41.811138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6114f-aaf2-4b70-9209-38d4894b5a11 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:41.830852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 264/527] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:41:41 2021] POST /identity/v3/users => generated 248 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:41:43.935020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c647-2675-4624-989a-ac0ce8352d69 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:43.935550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c647-2675-4624-989a-ac0ce8352d69 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:43.935638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c647-2675-4624-989a-ac0ce8352d69 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:43.937257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 264/528] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:43.942374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b975e3-c0ee-484f-ad08-69e431ac2df2 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:43.942807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b975e3-c0ee-484f-ad08-69e431ac2df2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:43.942963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b975e3-c0ee-484f-ad08-69e431ac2df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:43.964948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a1b975e3-c0ee-484f-ad08-69e431ac2df2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:43.966075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a1b975e3-c0ee-484f-ad08-69e431ac2df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:43.973488 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 265/529] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:43 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:43.996214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514c647-2675-4624-989a-ac0ce8352d69 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.008375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514c647-2675-4624-989a-ac0ce8352d69 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.012382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8680ae-d385-43ad-a79a-af6fda895722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.013095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8680ae-d385-43ad-a79a-af6fda895722 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.013385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8680ae-d385-43ad-a79a-af6fda895722 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.014312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8680ae-d385-43ad-a79a-af6fda895722 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.025160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8680ae-d385-43ad-a79a-af6fda895722 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:44.031679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-fa8680ae-d385-43ad-a79a-af6fda895722 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:41:44.032764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 265/530] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:41:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:44.038528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b975e3-c0ee-484f-ad08-69e431ac2df2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.047074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b975e3-c0ee-484f-ad08-69e431ac2df2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.051145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.051726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.052009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.052282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.052977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:44.053266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.054866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.063413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 266/531] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:44.068761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8680ae-d385-43ad-a79a-af6fda895722 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.078690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8680ae-d385-43ad-a79a-af6fda895722 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.082839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.083544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.083834 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.084114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.095938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.097801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.120081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:44.121201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 266/532] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:44.126966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.136229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585f8e-4022-43c0-9391-7d51534e0de8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.140267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.140841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.141123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.141396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.142071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:44.142363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.143953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.156410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 267/533] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:44.161822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.171715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad0e2d-11b2-4a52-9d88-541d29b99022 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.175833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.176547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.176838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.177117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.189473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.191512 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.209088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 25 14:41:44.210289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 267/534] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:44.216284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.226643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04e25b-3cb8-44c6-a80f-ca2416334480 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.230884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.231501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.231783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.232059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.233758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:44.234064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.235956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.265000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 268/535] 10.222.0.57 () {56 vars in 1158 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:44.270684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.280487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3170e-9f75-4aa5-a55c-7a19962e4ee3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.285290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0caa66-4c99-4866-9dfe-166ec79915e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.285920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0caa66-4c99-4866-9dfe-166ec79915e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.286211 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0caa66-4c99-4866-9dfe-166ec79915e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.286523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0caa66-4c99-4866-9dfe-166ec79915e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.294276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0caa66-4c99-4866-9dfe-166ec79915e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.296628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0caa66-4c99-4866-9dfe-166ec79915e3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.304943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 268/536] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:41:44.310551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.319854 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f77496-b9b2-4729-ae1b-629725225774 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.324000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.324716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.324999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.325276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.336640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.338383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.355447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:44.356561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 269/537] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:44.363087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0caa66-4c99-4866-9dfe-166ec79915e3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.371725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0caa66-4c99-4866-9dfe-166ec79915e3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.376109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.376691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.376978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.377259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.377954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:44.378252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.379853 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.393105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 269/538] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:44.398783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.409440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a88a-1fc3-4b4e-ac88-bf654e2c9268 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.414096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.414854 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.415137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.415678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.424401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.426343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.439769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:44.440860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 270/539] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:44.446705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.456519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaed9c-99f4-46fa-887f-307158ed6ea8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.460666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20146e6b-9c92-44dd-8ff7-07694dcee910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.461242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20146e6b-9c92-44dd-8ff7-07694dcee910 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.461531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20146e6b-9c92-44dd-8ff7-07694dcee910 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.461813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20146e6b-9c92-44dd-8ff7-07694dcee910 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.462600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20146e6b-9c92-44dd-8ff7-07694dcee910 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:44.462902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20146e6b-9c92-44dd-8ff7-07694dcee910 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.464715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20146e6b-9c92-44dd-8ff7-07694dcee910 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.482764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 270/540] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:44.488937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:44.498479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2bd8d-a4e3-4451-acbf-d943faf5fbf6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:44.502796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435f506-8494-444c-ba29-0c18d06b7816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:44.503369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f506-8494-444c-ba29-0c18d06b7816 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:44.503652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f506-8494-444c-ba29-0c18d06b7816 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:44.503927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f506-8494-444c-ba29-0c18d06b7816 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:44.504706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435f506-8494-444c-ba29-0c18d06b7816 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=c92f456ee8cf4564aaca2b16f320b49d) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:44.505005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435f506-8494-444c-ba29-0c18d06b7816 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:44.506880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435f506-8494-444c-ba29-0c18d06b7816 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:44.512253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 271/541] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:41:44 2021] GET /identity/v3/role_assignments?user.id=c92f456ee8cf4564aaca2b16f320b49d&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:46.580256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524073-e853-4a9b-a166-5f2442062d66 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.580784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524073-e853-4a9b-a166-5f2442062d66 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.580784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524073-e853-4a9b-a166-5f2442062d66 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.582521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 271/542] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:46.587722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e91fc-1311-4551-9da2-5e9b2d4124b4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.588151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e91fc-1311-4551-9da2-5e9b2d4124b4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.588273 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e91fc-1311-4551-9da2-5e9b2d4124b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.610070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-ea2e91fc-1311-4551-9da2-5e9b2d4124b4 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:46.611222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ea2e91fc-1311-4551-9da2-5e9b2d4124b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:46.618016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 272/543] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:46 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:46.640601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e524073-e853-4a9b-a166-5f2442062d66 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:46.652136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e524073-e853-4a9b-a166-5f2442062d66 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:46.656055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf884a56-2f41-449d-93b1-13c5c5b0febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:46.656760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf884a56-2f41-449d-93b1-13c5c5b0febc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.657040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf884a56-2f41-449d-93b1-13c5c5b0febc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.657315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf884a56-2f41-449d-93b1-13c5c5b0febc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.668003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf884a56-2f41-449d-93b1-13c5c5b0febc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:46.674994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-cf884a56-2f41-449d-93b1-13c5c5b0febc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:41:46.676065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 272/544] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:41:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:46.683647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e91fc-1311-4551-9da2-5e9b2d4124b4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:46.695714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e91fc-1311-4551-9da2-5e9b2d4124b4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:46.700219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:46.700824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.701132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.701412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.702120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:46.702439 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:46.704040 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:46.712335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 273/545] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:41:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:46.717947 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf884a56-2f41-449d-93b1-13c5c5b0febc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:46.727589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf884a56-2f41-449d-93b1-13c5c5b0febc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:46.731650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:46.732883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.733165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.733439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.744479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:46.746274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:46.763452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:46.764549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 273/546] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:41:46.770120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:46.779528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8783-7c80-40d9-ace6-2c8da4526ff7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:46.783596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:46.784178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.784462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.784740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.785416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:46.785711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:46.787321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:46.801329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 274/547] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:46.806722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:46.816513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50557f14-1484-4944-836e-1ed1ad248e69 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:46.820599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:46.821311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.821597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.821874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.835456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:46.837402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:46.855207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 25 14:41:46.856407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 274/548] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:41:46 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:46.863220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:46.873820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfca05b-8b20-40a0-bc96-17f3678477d6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:46.878157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:46.878811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.879103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.879385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.880200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:46.880504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:46.882428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:46.911604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 275/549] 10.222.0.57 () {56 vars in 1158 bytes} [Mon Oct 25 14:41:46 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:46.917299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:46.931353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8aa1c-d2bf-4c4d-9c82-3fa4ba2dfe07 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:46.936227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:46.936944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.937228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.937503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.949411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:46.951329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:46.968085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:46.969219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 275/550] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:46.974891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:46.985133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69675f1-ba04-4bf0-badb-a984f778f551 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:46.989283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:46.989989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:46.990281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:46.990589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:46.991276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:46.991570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:46.993145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:47.005700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 276/551] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:47.011273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:47.020600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e574ea3-5776-4e3a-bcdb-a93077933526 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:47.024630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:47.025330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:47.025614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:47.025888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:47.034992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:47.036932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:47.051167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:47.052263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 276/552] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:47.058003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:47.067373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cadc94-b9f5-4b58-9a3b-86cb901c118f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:47.071460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d38ad-47c2-4dfd-b0e6-1514843e7fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:47.072041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d38ad-47c2-4dfd-b0e6-1514843e7fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:47.072327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d38ad-47c2-4dfd-b0e6-1514843e7fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:47.072605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d38ad-47c2-4dfd-b0e6-1514843e7fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:47.073343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d38ad-47c2-4dfd-b0e6-1514843e7fe6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:47.073644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d38ad-47c2-4dfd-b0e6-1514843e7fe6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:47.075512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d38ad-47c2-4dfd-b0e6-1514843e7fe6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:47.088043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 277/553] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:47.094351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:47.104085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406ce1c-3c7d-48db-94bb-372433d56edf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:47.109031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876cff-6de0-456e-b779-8f65b3aedc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:47.109842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876cff-6de0-456e-b779-8f65b3aedc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:47.110130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876cff-6de0-456e-b779-8f65b3aedc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:47.110427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876cff-6de0-456e-b779-8f65b3aedc6c admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/c92f456ee8cf4564aaca2b16f320b49d/roles/7aaa6f36ae64405697ffb965e125aae6` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:47.129932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7876cff-6de0-456e-b779-8f65b3aedc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=c92f456ee8cf4564aaca2b16f320b49d, role_id=7aaa6f36ae64405697ffb965e125aae6)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:47.132583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7876cff-6de0-456e-b779-8f65b3aedc6c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:47.144676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 277/554] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:41:47 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/c92f456ee8cf4564aaca2b16f320b49d/roles/7aaa6f36ae64405697ffb965e125aae6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:41:49.197586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83201d5-981b-4231-aa8f-e16158dac0eb None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.198103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83201d5-981b-4231-aa8f-e16158dac0eb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.198103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83201d5-981b-4231-aa8f-e16158dac0eb None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.199742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 278/555] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:49.205324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3dfca-beb0-4e81-bdf9-12e4fbc17714 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.205690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3dfca-beb0-4e81-bdf9-12e4fbc17714 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.205884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3dfca-beb0-4e81-bdf9-12e4fbc17714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.228007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c1e3dfca-beb0-4e81-bdf9-12e4fbc17714 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:49.229148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c1e3dfca-beb0-4e81-bdf9-12e4fbc17714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:49.291589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 278/556] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:49 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:49.314413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83201d5-981b-4231-aa8f-e16158dac0eb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.325852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83201d5-981b-4231-aa8f-e16158dac0eb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.330386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb400391-8642-4971-8e04-2839ef5e3519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.331116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb400391-8642-4971-8e04-2839ef5e3519 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.331399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb400391-8642-4971-8e04-2839ef5e3519 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.331671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb400391-8642-4971-8e04-2839ef5e3519 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.342387 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb400391-8642-4971-8e04-2839ef5e3519 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:49.348879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-bb400391-8642-4971-8e04-2839ef5e3519 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:41:49.349957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 279/557] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:49.355757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3dfca-beb0-4e81-bdf9-12e4fbc17714 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.364781 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3dfca-beb0-4e81-bdf9-12e4fbc17714 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.368852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.369440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.369729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.370010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.370755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:49.371052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.372609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.381219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 279/558] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:49.386651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb400391-8642-4971-8e04-2839ef5e3519 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.396998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb400391-8642-4971-8e04-2839ef5e3519 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.401152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.401852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.402140 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.402442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.413412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.415263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.432042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:49.433112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 280/559] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:49.439164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.448557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850dd51-a8cb-48dc-bb55-90a4ebff2ecb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.453362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.453947 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.454236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.454565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.455267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:49.455569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.457181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.469728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 280/560] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:49.475298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.485337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86dc8-7264-47ff-8170-d358e97e6183 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.489684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.490542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.490838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.491119 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.505415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.507473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.526936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 25 14:41:49.528083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 281/561] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:49.533896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.543366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f557-a65c-4134-874c-c57907ff960b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.547604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.548197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.548488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.548772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.549564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:49.549867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.551733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.582783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 281/562] 10.222.0.57 () {56 vars in 1158 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:49.588419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.597709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7a9-661a-4eba-8e50-72e3e52d4f38 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.601779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9601b-b5f9-4923-8243-d8d9e29f1207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.602340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9601b-b5f9-4923-8243-d8d9e29f1207 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.602650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9601b-b5f9-4923-8243-d8d9e29f1207 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.602924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9601b-b5f9-4923-8243-d8d9e29f1207 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.610707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9601b-b5f9-4923-8243-d8d9e29f1207 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.612438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9601b-b5f9-4923-8243-d8d9e29f1207 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.620857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 282/563] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:41:49.627114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.645285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f600e7c-3d6c-4dc0-ab03-86e920820868 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.650639 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.651375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.651666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.651948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.663895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.665742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.683013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:49.684132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 282/564] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:41:49.690567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9601b-b5f9-4923-8243-d8d9e29f1207 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.699405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9601b-b5f9-4923-8243-d8d9e29f1207 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.703673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.704252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.704545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.704831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.705510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:49.705810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.707421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.720223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 283/565] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:49.725972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.740146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b70d4-58be-4934-9e30-a53702ac4516 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.745972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.746977 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.747201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.747478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.757354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.759319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.772636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:49.773761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 283/566] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:49.779676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.789151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7389f3-7a99-4d75-bc19-ece3e7037d8c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.793379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122d719-d03d-4375-81ec-9450ff0bf712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.794054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d719-d03d-4375-81ec-9450ff0bf712 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.794486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d719-d03d-4375-81ec-9450ff0bf712 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.795504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d719-d03d-4375-81ec-9450ff0bf712 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.796320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122d719-d03d-4375-81ec-9450ff0bf712 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:49.796715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122d719-d03d-4375-81ec-9450ff0bf712 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.798671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122d719-d03d-4375-81ec-9450ff0bf712 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.812980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 284/567] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:49.818946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:49.828535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49998-f0bd-4d5c-8cf4-11c26f7d8b24 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:49.832771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343eeda-10eb-436f-aad9-8a9e38b3f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:49.833341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343eeda-10eb-436f-aad9-8a9e38b3f5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:49.833627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343eeda-10eb-436f-aad9-8a9e38b3f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:49.833912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343eeda-10eb-436f-aad9-8a9e38b3f5f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:49.834729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343eeda-10eb-436f-aad9-8a9e38b3f5f0 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=c92f456ee8cf4564aaca2b16f320b49d) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:49.835033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343eeda-10eb-436f-aad9-8a9e38b3f5f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:49.836857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343eeda-10eb-436f-aad9-8a9e38b3f5f0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:49.842673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 284/568] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:41:49 2021] GET /identity/v3/role_assignments?user.id=c92f456ee8cf4564aaca2b16f320b49d&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:51.969825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e906da-861b-42a6-8758-e1a3a5f0c494 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:51.970344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e906da-861b-42a6-8758-e1a3a5f0c494 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:51.970456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e906da-861b-42a6-8758-e1a3a5f0c494 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:51.972073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 285/569] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:51.977188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947c876-0101-48fd-98f7-eb2b88d4e284 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:51.977608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947c876-0101-48fd-98f7-eb2b88d4e284 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:51.977750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947c876-0101-48fd-98f7-eb2b88d4e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:52.002281 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4947c876-0101-48fd-98f7-eb2b88d4e284 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:52.003460 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4947c876-0101-48fd-98f7-eb2b88d4e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:52.010562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 285/570] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:51 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:52.033770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e906da-861b-42a6-8758-e1a3a5f0c494 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:52.046265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e906da-861b-42a6-8758-e1a3a5f0c494 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:52.050160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:52.050962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:52.051242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:52.051517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:52.063410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:52.065214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:52.081591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:52.082627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 286/571] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:52.088432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947c876-0101-48fd-98f7-eb2b88d4e284 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:52.097030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947c876-0101-48fd-98f7-eb2b88d4e284 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:52.101230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeee45-12fd-4f9a-b202-13c5f86c2029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:52.101810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeee45-12fd-4f9a-b202-13c5f86c2029 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:52.102098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeee45-12fd-4f9a-b202-13c5f86c2029 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:52.102379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeee45-12fd-4f9a-b202-13c5f86c2029 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:52.103095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaeee45-12fd-4f9a-b202-13c5f86c2029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:52.103392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaeee45-12fd-4f9a-b202-13c5f86c2029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:52.104949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaeee45-12fd-4f9a-b202-13c5f86c2029 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:52.117696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 286/572] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:52.123621 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:52.132721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c6156-464f-45f1-9d0e-9be6cc9e9f03 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:52.136740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075a350-b844-4768-bdbf-07138dfc07c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:52.137316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075a350-b844-4768-bdbf-07138dfc07c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:52.137601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075a350-b844-4768-bdbf-07138dfc07c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:52.137878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075a350-b844-4768-bdbf-07138dfc07c5 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:52.138543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075a350-b844-4768-bdbf-07138dfc07c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:52.140420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075a350-b844-4768-bdbf-07138dfc07c5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:52.160253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 287/573] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:41:52 2021] POST /identity/v3/users => generated 254 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:41:54.271312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d7b7-92aa-4129-93f5-d5e800aa51a3 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.271805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d7b7-92aa-4129-93f5-d5e800aa51a3 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.271805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d7b7-92aa-4129-93f5-d5e800aa51a3 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.273470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 287/574] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:54.278818 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cb8d6-067e-49a3-8e0c-c569e4be56c8 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.279214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cb8d6-067e-49a3-8e0c-c569e4be56c8 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.279380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cb8d6-067e-49a3-8e0c-c569e4be56c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.301507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-898cb8d6-067e-49a3-8e0c-c569e4be56c8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:54.302687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-898cb8d6-067e-49a3-8e0c-c569e4be56c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:54.309572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 288/575] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:54 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:41:54.332839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d7b7-92aa-4129-93f5-d5e800aa51a3 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.344605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d7b7-92aa-4129-93f5-d5e800aa51a3 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.348622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9266b-3be5-4f6b-802e-52a8580fc868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.349331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9266b-3be5-4f6b-802e-52a8580fc868 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.349617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9266b-3be5-4f6b-802e-52a8580fc868 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.349896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9266b-3be5-4f6b-802e-52a8580fc868 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.361607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9266b-3be5-4f6b-802e-52a8580fc868 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:54.368077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-d1c9266b-3be5-4f6b-802e-52a8580fc868 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:41:54.369157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 288/576] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:54.375741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cb8d6-067e-49a3-8e0c-c569e4be56c8 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.384368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cb8d6-067e-49a3-8e0c-c569e4be56c8 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.388537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.389129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.389419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.389702 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.390436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:54.390768 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.392326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.400575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 289/577] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:54.406301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9266b-3be5-4f6b-802e-52a8580fc868 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.416016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9266b-3be5-4f6b-802e-52a8580fc868 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.420632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.421336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.421622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.421900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.433006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.434872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.452323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:54.453390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 289/578] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:54.459032 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.468235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8a4a-3aa2-430d-a748-f72e4ddbf196 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.472310 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.472885 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.473169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.473445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.474118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:54.474421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.475995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.489763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 290/579] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:54.495088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.504926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2f305-0ce0-4275-bac8-6222e47a1cde admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.509073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.509800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.510088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.510384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.522911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.524837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.543509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 14:41:54.545134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 290/580] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:54.550925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.560233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ff61b-3be2-4dc0-baf2-8feaa454b603 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.564376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.565076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.565370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.565647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.566449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:54.566760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.568595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.596495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 291/581] 10.222.0.57 () {56 vars in 1170 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:54.602075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.612230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd536ef-6066-4795-8775-4951f4792b45 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.616393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683297b-a065-4587-bcac-38cce1900458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.616953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683297b-a065-4587-bcac-38cce1900458 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.617242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683297b-a065-4587-bcac-38cce1900458 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.617524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683297b-a065-4587-bcac-38cce1900458 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.625101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683297b-a065-4587-bcac-38cce1900458 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.626871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683297b-a065-4587-bcac-38cce1900458 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.635217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 291/582] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:41:54.641181 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.651312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a4b92-a156-443e-a130-7ccc0add1b2d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.656184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.656934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.657218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.657492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.670683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.672553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.690108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:54.691268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 292/583] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:54.697139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683297b-a065-4587-bcac-38cce1900458 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.705826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683297b-a065-4587-bcac-38cce1900458 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.710034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.710642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.710931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.711216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.711904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:54.712203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.713775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.726739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 292/584] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:54.733155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.742638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4e9b5-3860-4ec0-93c8-b89c2bb2bc0a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.746685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.747389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.747744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.748020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.756425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.758341 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.771978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:54.773122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 293/585] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:54.779448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.789014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a315da-b748-4b19-9180-0b3c016984d7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.793238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c429a5-9e45-423e-97dc-8706dfb92953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.793822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c429a5-9e45-423e-97dc-8706dfb92953 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.794109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c429a5-9e45-423e-97dc-8706dfb92953 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.795143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c429a5-9e45-423e-97dc-8706dfb92953 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.795933 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c429a5-9e45-423e-97dc-8706dfb92953 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:54.796235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c429a5-9e45-423e-97dc-8706dfb92953 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.798091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c429a5-9e45-423e-97dc-8706dfb92953 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.811193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 293/586] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:54.817249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:54.826821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fd13c-7047-4e73-958c-bc0610e238b0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:54.830939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed155c5e-e722-46c3-aecb-0a3074adb700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:54.831516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed155c5e-e722-46c3-aecb-0a3074adb700 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:54.831803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed155c5e-e722-46c3-aecb-0a3074adb700 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:54.832084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed155c5e-e722-46c3-aecb-0a3074adb700 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:54.832859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed155c5e-e722-46c3-aecb-0a3074adb700 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=5a908a2911b944ccad0f51b8242fef4c) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:54.833161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed155c5e-e722-46c3-aecb-0a3074adb700 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:54.835025 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed155c5e-e722-46c3-aecb-0a3074adb700 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:54.840553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 294/587] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:41:54 2021] GET /identity/v3/role_assignments?user.id=5a908a2911b944ccad0f51b8242fef4c&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:56.940605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6cda-469f-4a94-9030-c4d5ae63eced None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:56.941146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6cda-469f-4a94-9030-c4d5ae63eced None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:56.941146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6cda-469f-4a94-9030-c4d5ae63eced None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:56.942871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 294/588] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:56.948238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff9b0a-d85b-44b2-ab5b-9d2bf55fffb5 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:56.948681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff9b0a-d85b-44b2-ab5b-9d2bf55fffb5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:56.948797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff9b0a-d85b-44b2-ab5b-9d2bf55fffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:56.971020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-bbff9b0a-d85b-44b2-ab5b-9d2bf55fffb5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:56.972146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bbff9b0a-d85b-44b2-ab5b-9d2bf55fffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:56.978941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 295/589] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:56 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:41:57.004488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e6cda-469f-4a94-9030-c4d5ae63eced None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.016923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e6cda-469f-4a94-9030-c4d5ae63eced None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.020954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6c329-3194-4651-a3c8-6d07513b1707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.021670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6c329-3194-4651-a3c8-6d07513b1707 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.021961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6c329-3194-4651-a3c8-6d07513b1707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.022244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6c329-3194-4651-a3c8-6d07513b1707 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.033488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6c329-3194-4651-a3c8-6d07513b1707 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:57.040018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-13b6c329-3194-4651-a3c8-6d07513b1707 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:41:57.041125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 295/590] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:57.047158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff9b0a-d85b-44b2-ab5b-9d2bf55fffb5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.055706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff9b0a-d85b-44b2-ab5b-9d2bf55fffb5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.059785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.060877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.061160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.061434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.062134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:57.062454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.064023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.072324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 296/591] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:57.078425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6c329-3194-4651-a3c8-6d07513b1707 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.088168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6c329-3194-4651-a3c8-6d07513b1707 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.092467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.093171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.093461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.093742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.104649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.106505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.124246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:57.125325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 296/592] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:57.130893 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.140711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3e257-b00a-4762-8f7d-8c24f40e5049 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.144824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.145409 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.145700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.145979 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.146703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:57.147001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.148565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.160724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 297/593] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:57.166189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.175822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4a0d-c33a-4993-8d33-3189b69a28c3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.179898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.180618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.180900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.181176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.193978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.196022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.213440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 14:41:57.214524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 297/594] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:57.220151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.229451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b8a07-9833-4f08-98cd-212818eb84dd admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.234306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.234919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.235208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.235488 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.236274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:57.236572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.238387 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.266370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 298/595] 10.222.0.57 () {56 vars in 1170 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:57.271796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.281020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcba5d-603b-45af-858a-10852cb56d48 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.285079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.285801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.286085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.286359 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.299843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.301695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.320291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:57.321467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 298/596] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:57.327263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.336853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6ede6-aa00-42c0-a413-c452cee961bc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.341143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.341736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.342027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.342311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.343042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:57.343336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.344922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.357723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 299/597] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:57.363627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.373554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfed6-81bb-4e07-8032-b0cea870645b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.377637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.378346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.378657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.378935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.387447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.389371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.403175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:41:57.404279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 299/598] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:57.410045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.419896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeafcef-02a3-4b1a-b390-905b273f2366 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.424069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b787460-ebbe-4589-bdb7-aac7d62b9006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.424637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787460-ebbe-4589-bdb7-aac7d62b9006 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.424925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787460-ebbe-4589-bdb7-aac7d62b9006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.425206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787460-ebbe-4589-bdb7-aac7d62b9006 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.425941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b787460-ebbe-4589-bdb7-aac7d62b9006 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:57.426242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b787460-ebbe-4589-bdb7-aac7d62b9006 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.428109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b787460-ebbe-4589-bdb7-aac7d62b9006 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.441403 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 300/599] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:41:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:57.447325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:57.456671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494cdd3-6e93-40dc-87c8-b6a39bbc80f1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:57.460805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aba874-ab8d-4c63-aead-147419e3948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:57.461608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aba874-ab8d-4c63-aead-147419e3948c admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:57.461893 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aba874-ab8d-4c63-aead-147419e3948c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:57.462168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aba874-ab8d-4c63-aead-147419e3948c admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/5a908a2911b944ccad0f51b8242fef4c/roles/7aaa6f36ae64405697ffb965e125aae6` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:57.483139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aba874-ab8d-4c63-aead-147419e3948c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=5a908a2911b944ccad0f51b8242fef4c, role_id=7aaa6f36ae64405697ffb965e125aae6)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:57.485988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aba874-ab8d-4c63-aead-147419e3948c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:57.499023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 300/600] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:41:57 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/5a908a2911b944ccad0f51b8242fef4c/roles/7aaa6f36ae64405697ffb965e125aae6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:41:59.551524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec4b4-8130-4558-bfc2-c070d785271c None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.552092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec4b4-8130-4558-bfc2-c070d785271c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.552092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec4b4-8130-4558-bfc2-c070d785271c None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.553742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 301/601] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:41:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:41:59.558964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685071a8-af1a-4028-a23e-1afb33863e40 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.559377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685071a8-af1a-4028-a23e-1afb33863e40 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.559530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685071a8-af1a-4028-a23e-1afb33863e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.581582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-685071a8-af1a-4028-a23e-1afb33863e40 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:41:59.582749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-685071a8-af1a-4028-a23e-1afb33863e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:41:59.646650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 301/602] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:41:59 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:41:59.668942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec4b4-8130-4558-bfc2-c070d785271c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:59.680950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec4b4-8130-4558-bfc2-c070d785271c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:59.684992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401967-3975-4a19-905f-a614464ae8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:59.686121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401967-3975-4a19-905f-a614464ae8ef admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.686422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401967-3975-4a19-905f-a614464ae8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.686712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401967-3975-4a19-905f-a614464ae8ef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.697518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e401967-3975-4a19-905f-a614464ae8ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:41:59.704047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-3e401967-3975-4a19-905f-a614464ae8ef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:41:59.705141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 302/603] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:41:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:59.710985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685071a8-af1a-4028-a23e-1afb33863e40 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:59.719549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685071a8-af1a-4028-a23e-1afb33863e40 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:59.723643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:59.724227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.724511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.724791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.725497 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:59.725792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:59.727387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:59.736171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 302/604] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:41:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:59.741367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401967-3975-4a19-905f-a614464ae8ef admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:59.751598 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401967-3975-4a19-905f-a614464ae8ef admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:59.755684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:59.756381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.756664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.756941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.767769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:59.769566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:59.787262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:41:59.788371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 303/605] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:59.793969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:59.804153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f4d6-3c0d-40f9-8dc2-375cc2c42e11 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:59.808466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:59.809054 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.809335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.809613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.810326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:59.810677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:59.812253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:59.824792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 303/606] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:41:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:41:59.830215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:59.839656 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d3ef-3241-4313-b509-146e77221a61 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:59.844284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:59.845013 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.845296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.845572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.860221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:59.862202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:59.879840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 14:41:59.880910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 304/607] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:41:59 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:41:59.886640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:59.895971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866f6c-0c13-4713-9e48-0b517bf531bb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:59.900244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:59.900831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.901114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.901388 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.902168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:41:59.902494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:59.904817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:59.936350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 304/608] 10.222.0.57 () {56 vars in 1170 bytes} [Mon Oct 25 14:41:59 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:41:59.942416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:59.952013 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fea9bf-5b78-4888-ab67-3e402b857da6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:59.956189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad1696-b8fe-4021-8601-ba1196ab2ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:59.956764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad1696-b8fe-4021-8601-ba1196ab2ebe admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.957051 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad1696-b8fe-4021-8601-ba1196ab2ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.957328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad1696-b8fe-4021-8601-ba1196ab2ebe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:41:59.966595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad1696-b8fe-4021-8601-ba1196ab2ebe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:41:59.968325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad1696-b8fe-4021-8601-ba1196ab2ebe admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:41:59.976752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 305/609] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:41:59 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:41:59.983075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:41:59.992607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea10354-9e71-444d-8246-aa25bcf1ba6d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:41:59.996906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:41:59.997623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:41:59.997909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:41:59.998190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:00.009761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:00.011590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:00.028076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:00.029665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 305/610] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:41:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:00.035261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad1696-b8fe-4021-8601-ba1196ab2ebe admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:00.043804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad1696-b8fe-4021-8601-ba1196ab2ebe admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:00.048692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:00.049269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:00.049557 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:00.049839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:00.050562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:00.050860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:00.052438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:00.064966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 306/611] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:00.070623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:00.080025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf01f4-467a-4b12-be84-2ad8e62d801a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:00.084148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:00.085010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:00.085280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:00.085560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:00.094544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:00.096489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:00.110808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:42:00.111948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 306/612] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:42:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:00.117937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:00.127456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96835db-71a0-41b0-b97f-2cd368a5f133 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:00.131576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f1e0b-246d-408c-961b-2bc63c4a25b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:00.132156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1e0b-246d-408c-961b-2bc63c4a25b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:00.132443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1e0b-246d-408c-961b-2bc63c4a25b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:00.132725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1e0b-246d-408c-961b-2bc63c4a25b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:00.133453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f1e0b-246d-408c-961b-2bc63c4a25b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:00.133752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f1e0b-246d-408c-961b-2bc63c4a25b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:00.135651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f1e0b-246d-408c-961b-2bc63c4a25b5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:00.148895 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 307/613] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:42:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:00.155633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:00.168757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f62e02-18f1-4d6f-82fa-786229db6921 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:00.174028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30067e1-5d64-4c7e-a9b2-22015c47ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:00.174646 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30067e1-5d64-4c7e-a9b2-22015c47ea47 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:00.174936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30067e1-5d64-4c7e-a9b2-22015c47ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:00.175216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30067e1-5d64-4c7e-a9b2-22015c47ea47 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:00.176008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30067e1-5d64-4c7e-a9b2-22015c47ea47 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=5a908a2911b944ccad0f51b8242fef4c) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:00.176311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30067e1-5d64-4c7e-a9b2-22015c47ea47 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:00.178149 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30067e1-5d64-4c7e-a9b2-22015c47ea47 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:00.184260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 307/614] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:42:00 2021] GET /identity/v3/role_assignments?user.id=5a908a2911b944ccad0f51b8242fef4c&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:02.287642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d2bca-ee21-4894-a9ca-ca43bef1f0d4 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.288170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d2bca-ee21-4894-a9ca-ca43bef1f0d4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.288170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d2bca-ee21-4894-a9ca-ca43bef1f0d4 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.289746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 308/615] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:02.294791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c55d-7d56-4766-a53a-700978b4362c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.295171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c55d-7d56-4766-a53a-700978b4362c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.295351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c55d-7d56-4766-a53a-700978b4362c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.318292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-faf2c55d-7d56-4766-a53a-700978b4362c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:02.319452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-faf2c55d-7d56-4766-a53a-700978b4362c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:02.326991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 308/616] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:02 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:02.349469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d2bca-ee21-4894-a9ca-ca43bef1f0d4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.361304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d2bca-ee21-4894-a9ca-ca43bef1f0d4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.365170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64164ba-d8c2-4935-a18e-157e6f1ed1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.365888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64164ba-d8c2-4935-a18e-157e6f1ed1cc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.366171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64164ba-d8c2-4935-a18e-157e6f1ed1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.366466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64164ba-d8c2-4935-a18e-157e6f1ed1cc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.377682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64164ba-d8c2-4935-a18e-157e6f1ed1cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:42:02.384592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-a64164ba-d8c2-4935-a18e-157e6f1ed1cc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 14:42:02.385674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 309/617] 10.222.0.57 () {56 vars in 1141 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:02.392164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2c55d-7d56-4766-a53a-700978b4362c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.400710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2c55d-7d56-4766-a53a-700978b4362c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.404801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.405379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.405662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.405939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.406681 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:02.406975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.408539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.416756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 309/618] 10.222.0.57 () {56 vars in 1136 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:02.422774 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64164ba-d8c2-4935-a18e-157e6f1ed1cc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.432535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64164ba-d8c2-4935-a18e-157e6f1ed1cc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.437248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.437951 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.438240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.438567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.449686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.451525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.468591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:02.469684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 310/619] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:02.475310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.485169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf645775-0c92-4989-940a-4ae8cf65ce0d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.489196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.489763 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.490045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.490322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.491031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:02.491325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.492865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.505239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 310/620] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:02.510357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.519503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a52b45-88da-4540-8548-dfaef6a5062e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.523615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.524336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.524626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.524907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.537166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.539309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.558148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 14:42:02.559261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 311/621] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:02.565482 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.574798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a3e4f-52e6-4b2f-9bd1-422fc123e454 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.578875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.579466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.579753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.580033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.580818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:02.581116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.582966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.613268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 311/622] 10.222.0.57 () {56 vars in 1170 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:02.619039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.628945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910d3de-7c77-4bd5-adae-152fc47d6c4e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.633004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd00db4-14e9-40dc-9a82-afa60def1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.633569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00db4-14e9-40dc-9a82-afa60def1e5e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.633857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00db4-14e9-40dc-9a82-afa60def1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.634135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00db4-14e9-40dc-9a82-afa60def1e5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.641702 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd00db4-14e9-40dc-9a82-afa60def1e5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.643464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd00db4-14e9-40dc-9a82-afa60def1e5e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.652146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 312/623] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:42:02.657932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.667297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39760-bf04-4efa-856a-331a31737143 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.671859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.672568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.672853 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.673168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.686124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.688058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.706194 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:02.707416 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 312/624] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:02.713148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd00db4-14e9-40dc-9a82-afa60def1e5e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.721926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd00db4-14e9-40dc-9a82-afa60def1e5e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.726280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.726895 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.727185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.727468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.728149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:02.728449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.730026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.743472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 313/625] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:02.749638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.759011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580feb3a-f016-4253-9a2a-9105e8f50254 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.763063 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.763766 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.764049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.764323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.772614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.774558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.788349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:42:02.789505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 313/626] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:02.795763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.805303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bbeb-5d8a-4431-bf41-f10e1fed46f0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.810361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132b05d-f33c-4804-be21-d25b901ffb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.810979 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b05d-f33c-4804-be21-d25b901ffb08 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.811269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b05d-f33c-4804-be21-d25b901ffb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.811553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b05d-f33c-4804-be21-d25b901ffb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.812299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132b05d-f33c-4804-be21-d25b901ffb08 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:02.812599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132b05d-f33c-4804-be21-d25b901ffb08 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.814454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132b05d-f33c-4804-be21-d25b901ffb08 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.827326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 314/627] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:02.833378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:02.843455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95c3e3-6316-4d3e-a356-e93eaef0c216 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:02.847579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54158b-0adb-4541-b22c-59c8b2f18ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:02.848154 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54158b-0adb-4541-b22c-59c8b2f18ebd admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:02.848445 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54158b-0adb-4541-b22c-59c8b2f18ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:02.848727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54158b-0adb-4541-b22c-59c8b2f18ebd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:02.849514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54158b-0adb-4541-b22c-59c8b2f18ebd admin admin] RBAC: Adding query filter params (role.id=4a58aa8728584976ad1c9875ab382bb4, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=5a908a2911b944ccad0f51b8242fef4c) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:02.849817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54158b-0adb-4541-b22c-59c8b2f18ebd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:02.851686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54158b-0adb-4541-b22c-59c8b2f18ebd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:02.857871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 314/628] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:42:02 2021] GET /identity/v3/role_assignments?user.id=5a908a2911b944ccad0f51b8242fef4c&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=4a58aa8728584976ad1c9875ab382bb4 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:04.901981 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea94d-9903-4caf-b467-956394be52f2 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:04.902536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea94d-9903-4caf-b467-956394be52f2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:04.902625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea94d-9903-4caf-b467-956394be52f2 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:04.904921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 315/629] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:04.909954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e78247-75f3-4b53-8c29-c1966bb4390d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:04.910451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e78247-75f3-4b53-8c29-c1966bb4390d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:04.910543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e78247-75f3-4b53-8c29-c1966bb4390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:04.932198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d5e78247-75f3-4b53-8c29-c1966bb4390d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:04.933338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d5e78247-75f3-4b53-8c29-c1966bb4390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:04.940230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 315/630] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:04 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:04.962392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ea94d-9903-4caf-b467-956394be52f2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:04.974786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ea94d-9903-4caf-b467-956394be52f2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:04.978813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953eca-858b-44b0-a51e-9c53703444e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:04.979542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953eca-858b-44b0-a51e-9c53703444e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:04.979829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953eca-858b-44b0-a51e-9c53703444e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:04.980108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953eca-858b-44b0-a51e-9c53703444e3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:04.991351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a953eca-858b-44b0-a51e-9c53703444e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:42:04.998869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-3a953eca-858b-44b0-a51e-9c53703444e3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 14:42:04.999957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 316/631] 10.222.0.57 () {56 vars in 1141 bytes} [Mon Oct 25 14:42:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:05.005756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e78247-75f3-4b53-8c29-c1966bb4390d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.015040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e78247-75f3-4b53-8c29-c1966bb4390d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.019765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.020757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.021065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.021345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.022088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:05.022383 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.023988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.032488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 316/632] 10.222.0.57 () {56 vars in 1136 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:05.038205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953eca-858b-44b0-a51e-9c53703444e3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.048139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953eca-858b-44b0-a51e-9c53703444e3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.052297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.053008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.053296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.053577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.065136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.066993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.084553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:05.085581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 317/633] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:05.091408 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.100733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bae1ea-df90-48a2-800b-a93ef971f1b5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.104829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.105407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.105692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.105971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.106705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:05.107002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.108826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.120827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 317/634] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:05.126817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.136048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bfb4c-2a79-4da3-914e-f14f385ea06e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.142317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.143574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.143870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.144156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.159205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.161221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.179583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 14:42:05.180679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 318/635] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:05.187442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.196713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9b461-cc4f-449d-bd84-4a19761b7b62 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.201440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.202025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.202311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.202618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.203399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:05.203697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.205503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.232715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 318/636] 10.222.0.57 () {56 vars in 1170 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:05.238590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.248449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0e061-c739-4521-a946-e745a53b9644 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.252536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.253248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.253538 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.253821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.265883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.267745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.284443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:05.285528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 319/637] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:05.291136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.300485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c84e-211f-441b-b119-7bad40093fff admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.304586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.305192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.305450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.305727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.306426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:05.306738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.308297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.321098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 319/638] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:05.327791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.337787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b843f-32bd-4e3d-805a-07d5180e852d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.342008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.342796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.343117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.343406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.353925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.355937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.370201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:42:05.371354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 320/639] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:05.377907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.387425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04eba1-b32e-4f4e-b6c8-426a3e62e1be admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.392176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3b45b-7b77-443b-9d2d-f9d8e45293e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.392754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3b45b-7b77-443b-9d2d-f9d8e45293e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.393038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3b45b-7b77-443b-9d2d-f9d8e45293e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.393316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3b45b-7b77-443b-9d2d-f9d8e45293e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.394065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3b45b-7b77-443b-9d2d-f9d8e45293e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:05.394368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3b45b-7b77-443b-9d2d-f9d8e45293e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.396224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3b45b-7b77-443b-9d2d-f9d8e45293e4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.408771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 320/640] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:42:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:05.414731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:05.424665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b92a7-d4d3-4d78-8abe-904f9ac881b6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:05.428840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81f937-c8ce-4ac3-8e2e-5902a778ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:05.429651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81f937-c8ce-4ac3-8e2e-5902a778ebfa admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:05.429941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81f937-c8ce-4ac3-8e2e-5902a778ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:05.430223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81f937-c8ce-4ac3-8e2e-5902a778ebfa admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/5a908a2911b944ccad0f51b8242fef4c/roles/4a58aa8728584976ad1c9875ab382bb4` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:05.432302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81f937-c8ce-4ac3-8e2e-5902a778ebfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=5a908a2911b944ccad0f51b8242fef4c, role_id=4a58aa8728584976ad1c9875ab382bb4)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:05.435576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81f937-c8ce-4ac3-8e2e-5902a778ebfa admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:05.448184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 321/641] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:42:05 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/5a908a2911b944ccad0f51b8242fef4c/roles/4a58aa8728584976ad1c9875ab382bb4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:42:07.540678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2389b-2e1a-4f2e-baa7-319bb8db69f1 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.541231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2389b-2e1a-4f2e-baa7-319bb8db69f1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.541231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2389b-2e1a-4f2e-baa7-319bb8db69f1 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.542955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 321/642] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:07.548336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9cc6d-bd56-43b6-9347-e11efdf373c7 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.548743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9cc6d-bd56-43b6-9347-e11efdf373c7 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.548900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9cc6d-bd56-43b6-9347-e11efdf373c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.570938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-8bd9cc6d-bd56-43b6-9347-e11efdf373c7 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:07.572095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8bd9cc6d-bd56-43b6-9347-e11efdf373c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:07.634892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 322/643] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:07 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:07.658131 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2389b-2e1a-4f2e-baa7-319bb8db69f1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:07.670385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2389b-2e1a-4f2e-baa7-319bb8db69f1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:07.674335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498454ba-3b73-48eb-a0a9-9853b7559815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:07.675075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498454ba-3b73-48eb-a0a9-9853b7559815 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.675357 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498454ba-3b73-48eb-a0a9-9853b7559815 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.675628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498454ba-3b73-48eb-a0a9-9853b7559815 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.687037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498454ba-3b73-48eb-a0a9-9853b7559815 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:42:07.693838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-498454ba-3b73-48eb-a0a9-9853b7559815 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 14:42:07.694968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 322/644] 10.222.0.57 () {56 vars in 1141 bytes} [Mon Oct 25 14:42:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:07.700869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9cc6d-bd56-43b6-9347-e11efdf373c7 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:07.709733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9cc6d-bd56-43b6-9347-e11efdf373c7 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:07.715303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:07.715908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.716199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.716483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.717206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:07.717506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:07.719288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:07.727902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 323/645] 10.222.0.57 () {56 vars in 1136 bytes} [Mon Oct 25 14:42:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:07.734666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498454ba-3b73-48eb-a0a9-9853b7559815 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:07.744458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498454ba-3b73-48eb-a0a9-9853b7559815 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:07.749106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:07.749800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.750084 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.750363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.761101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:07.762990 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:07.779554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:07.780632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 323/646] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:07.786264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:07.796038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7ddd8-d2d3-4509-ae09-86dca15efdae admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:07.800142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:07.800723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.801008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.801287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.801971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:07.802264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:07.803861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:07.816617 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 324/647] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:07.822180 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:07.831508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995526d-daa7-4eca-9fd2-9125a48be8d7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:07.835544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:07.836261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.836545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.836821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.849110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:07.851119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:07.869450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 14:42:07.870547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 324/648] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:42:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:42:07.876698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:07.885876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036b6fd-9226-4561-a153-269aa5514de1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:07.890156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:07.890867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.891143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.891421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.892196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:07.892494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:07.894330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:07.923127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 325/649] 10.222.0.57 () {56 vars in 1170 bytes} [Mon Oct 25 14:42:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:07.929020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:07.939517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af817f2-4a92-4a55-9b80-7e5bcbd27375 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:07.943882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b7700-d1b5-42b2-a090-2e64d8be8de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:07.944475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b7700-d1b5-42b2-a090-2e64d8be8de9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.944761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b7700-d1b5-42b2-a090-2e64d8be8de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.945039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b7700-d1b5-42b2-a090-2e64d8be8de9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.953955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b7700-d1b5-42b2-a090-2e64d8be8de9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:07.955744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b7700-d1b5-42b2-a090-2e64d8be8de9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:07.965037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 325/650] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:42:07 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:42:07.970956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:07.980273 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901c87b-e0bb-4b1d-b233-4ffff394d317 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:07.985099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:07.985816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:07.986101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:07.986377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:07.998461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:08.000266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:08.016898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:08.017997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 326/651] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:08.023597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b7700-d1b5-42b2-a090-2e64d8be8de9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:08.032687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b7700-d1b5-42b2-a090-2e64d8be8de9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:08.036838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:08.037416 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:08.037720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:08.038004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:08.038729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:08.039032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:08.040581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:08.054494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 326/652] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:08.059709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:08.069124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befb9c-8445-4477-8d54-1f4a0dec96fc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:08.073237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:08.073954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:08.074245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:08.074570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:08.082922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:08.084859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:08.099169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:42:08.100280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 327/653] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:42:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:08.106187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:08.116371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96d83-84a8-456f-a460-efd77414ebc4 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:08.120466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f11a41-9e94-4fed-8202-e9c8b2faedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:08.121043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11a41-9e94-4fed-8202-e9c8b2faedb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:08.121346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11a41-9e94-4fed-8202-e9c8b2faedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:08.121608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11a41-9e94-4fed-8202-e9c8b2faedb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:08.122349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f11a41-9e94-4fed-8202-e9c8b2faedb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:08.122679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f11a41-9e94-4fed-8202-e9c8b2faedb6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:08.124505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f11a41-9e94-4fed-8202-e9c8b2faedb6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:08.138861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 327/654] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:42:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:08.144987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:08.155420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8709d5-a815-429f-8615-07136278cf99 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:08.159540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76fd45-77c3-49c2-8645-76d208c18204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:08.160121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76fd45-77c3-49c2-8645-76d208c18204 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:08.160405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76fd45-77c3-49c2-8645-76d208c18204 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:08.160687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76fd45-77c3-49c2-8645-76d208c18204 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:08.161472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76fd45-77c3-49c2-8645-76d208c18204 admin admin] RBAC: Adding query filter params (role.id=4a58aa8728584976ad1c9875ab382bb4, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=5a908a2911b944ccad0f51b8242fef4c) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:08.161773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76fd45-77c3-49c2-8645-76d208c18204 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:08.163657 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76fd45-77c3-49c2-8645-76d208c18204 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:08.170453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 328/655] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:42:08 2021] GET /identity/v3/role_assignments?user.id=5a908a2911b944ccad0f51b8242fef4c&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=4a58aa8728584976ad1c9875ab382bb4 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:10.263978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0e966-eb4e-42cb-9f43-6f47cf800ca2 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:10.264473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0e966-eb4e-42cb-9f43-6f47cf800ca2 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:10.264473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0e966-eb4e-42cb-9f43-6f47cf800ca2 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:10.266096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 328/656] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:10.271076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9338-47f7-4ef5-8e03-601cc74c11b7 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:10.271446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9338-47f7-4ef5-8e03-601cc74c11b7 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:10.271642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9338-47f7-4ef5-8e03-601cc74c11b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:10.293566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f4ab9338-47f7-4ef5-8e03-601cc74c11b7 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:10.295350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f4ab9338-47f7-4ef5-8e03-601cc74c11b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:10.302049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 329/657] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:10 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:10.323482 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0e966-eb4e-42cb-9f43-6f47cf800ca2 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:10.335078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0e966-eb4e-42cb-9f43-6f47cf800ca2 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:10.339005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:10.339706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:10.339990 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:10.340265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:10.341383 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:10.342967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:10.353013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 14:42:10.354068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 329/658] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 25 14:42:10 2021] GET /identity/v3/services/image => generated 86 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:42:10.360646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9338-47f7-4ef5-8e03-601cc74c11b7 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:10.369126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9338-47f7-4ef5-8e03-601cc74c11b7 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:10.373201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fc56a-4fe8-43ae-9d33-4960261ea798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:10.373781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fc56a-4fe8-43ae-9d33-4960261ea798 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:10.374064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fc56a-4fe8-43ae-9d33-4960261ea798 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:10.374338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fc56a-4fe8-43ae-9d33-4960261ea798 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:10.375031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fc56a-4fe8-43ae-9d33-4960261ea798 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:10.375326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fc56a-4fe8-43ae-9d33-4960261ea798 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:10.376909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fc56a-4fe8-43ae-9d33-4960261ea798 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:10.381174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 330/659] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:10 2021] GET /identity/v3/services?name=image => generated 122 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:10.386605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:10.395790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030a9ff-e8bd-4039-8153-9a0c1e2214f0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:10.399837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96e798-f521-443c-83ba-e4f8a455c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:10.400413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96e798-f521-443c-83ba-e4f8a455c534 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:10.400700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96e798-f521-443c-83ba-e4f8a455c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:10.400976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96e798-f521-443c-83ba-e4f8a455c534 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:10.401648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96e798-f521-443c-83ba-e4f8a455c534 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:10.401942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96e798-f521-443c-83ba-e4f8a455c534 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:10.404050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96e798-f521-443c-83ba-e4f8a455c534 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:10.408346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 330/660] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:10 2021] GET /identity/v3/services?type=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:12.459546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6fdbb-dfd5-4b83-b2e5-1dc08a2bbc91 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:12.460077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6fdbb-dfd5-4b83-b2e5-1dc08a2bbc91 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:12.460165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6fdbb-dfd5-4b83-b2e5-1dc08a2bbc91 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:12.461767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 331/661] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:12.467415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05706d9-fc25-4996-a433-e499a2a16eff None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:12.467786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05706d9-fc25-4996-a433-e499a2a16eff None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:12.467967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05706d9-fc25-4996-a433-e499a2a16eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:12.489597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d05706d9-fc25-4996-a433-e499a2a16eff None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:12.490759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d05706d9-fc25-4996-a433-e499a2a16eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:12.498003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 331/662] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:12 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:12.520112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6fdbb-dfd5-4b83-b2e5-1dc08a2bbc91 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:12.532358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6fdbb-dfd5-4b83-b2e5-1dc08a2bbc91 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:12.536301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b8966-ed7b-4750-8e13-54f2e5412864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:12.536876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8966-ed7b-4750-8e13-54f2e5412864 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:12.537164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8966-ed7b-4750-8e13-54f2e5412864 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:12.537447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8966-ed7b-4750-8e13-54f2e5412864 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:12.538111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8966-ed7b-4750-8e13-54f2e5412864 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:12.539717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8966-ed7b-4750-8e13-54f2e5412864 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:12.553034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 332/663] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:42:12 2021] POST /identity/v3/services => generated 242 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:42:14.651586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b632b-56e9-48c3-8076-351e9cafbce1 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:14.652106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b632b-56e9-48c3-8076-351e9cafbce1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:14.652106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b632b-56e9-48c3-8076-351e9cafbce1 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:14.653772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 332/664] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:14.658860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d616d0-bd1d-420b-adfe-dfc3b8196fbf None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:14.659285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d616d0-bd1d-420b-adfe-dfc3b8196fbf None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:14.659427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d616d0-bd1d-420b-adfe-dfc3b8196fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:14.681524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-81d616d0-bd1d-420b-adfe-dfc3b8196fbf None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:14.682699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-81d616d0-bd1d-420b-adfe-dfc3b8196fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:14.700193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 333/665] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:14 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:14.721818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b632b-56e9-48c3-8076-351e9cafbce1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:14.734384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b632b-56e9-48c3-8076-351e9cafbce1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:14.738324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:14.739046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:14.739326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:14.739600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] PATH_INFO: `/v3/services/image` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:14.740216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:14.741768 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:14.752379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 14:42:14.753419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 333/666] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 25 14:42:14 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:14.759259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d616d0-bd1d-420b-adfe-dfc3b8196fbf None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:14.768028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d616d0-bd1d-420b-adfe-dfc3b8196fbf None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:14.772182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:14.772768 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:14.773058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:14.773342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:14.774012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:14.774312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:14.775939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:14.780881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 334/667] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:14 2021] GET /identity/v3/services?name=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:14.786477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:14.796556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3a945-541f-4157-9dd0-332b5050b9df admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:14.800750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176065a-6d94-44db-a509-441716259776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:14.801332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176065a-6d94-44db-a509-441716259776 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:14.801625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176065a-6d94-44db-a509-441716259776 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:14.801906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176065a-6d94-44db-a509-441716259776 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:14.802619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176065a-6d94-44db-a509-441716259776 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:14.802924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176065a-6d94-44db-a509-441716259776 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:14.804667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176065a-6d94-44db-a509-441716259776 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:14.809723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 334/668] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:14 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:14.815546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:14.824865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace404-1c9c-4f6e-b421-3546251f1ad1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:14.828884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6558de-1971-4eef-b4f5-51177513a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:14.829458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6558de-1971-4eef-b4f5-51177513a07b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:14.829740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6558de-1971-4eef-b4f5-51177513a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:14.830016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6558de-1971-4eef-b4f5-51177513a07b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:14.830793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6558de-1971-4eef-b4f5-51177513a07b admin admin] RBAC: Adding query filter params (interface=public, service_id=7e922eabab734cbd9103a34d9848c97d, region_id=RegionOne) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:14.831092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6558de-1971-4eef-b4f5-51177513a07b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:14.832660 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6558de-1971-4eef-b4f5-51177513a07b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:14.837907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 335/669] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:42:14 2021] GET /identity/v3/endpoints?service_id=7e922eabab734cbd9103a34d9848c97d&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:14.843954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176065a-6d94-44db-a509-441716259776 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:14.853269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176065a-6d94-44db-a509-441716259776 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:14.857996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702a470-984a-43ac-9cdc-8efc6253f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:14.858866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a470-984a-43ac-9cdc-8efc6253f445 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:14.859156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a470-984a-43ac-9cdc-8efc6253f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:14.859438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a470-984a-43ac-9cdc-8efc6253f445 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:14.860090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702a470-984a-43ac-9cdc-8efc6253f445 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:14.861673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702a470-984a-43ac-9cdc-8efc6253f445 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:14.866835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 335/670] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:42:14 2021] GET /identity/v3/services => generated 1022 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:42:16.954026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3685-ed53-4e55-855e-82738a300cee None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:16.954572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3685-ed53-4e55-855e-82738a300cee None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:16.954648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3685-ed53-4e55-855e-82738a300cee None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:16.956287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 336/671] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:16.961640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610b5b-6343-418a-a178-6aed133231dc None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:16.962037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610b5b-6343-418a-a178-6aed133231dc None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:16.962207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610b5b-6343-418a-a178-6aed133231dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:16.984608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8c610b5b-6343-418a-a178-6aed133231dc None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:16.985755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8c610b5b-6343-418a-a178-6aed133231dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:16.992740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 336/672] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:16 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:17.015985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb3685-ed53-4e55-855e-82738a300cee None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:17.027646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb3685-ed53-4e55-855e-82738a300cee None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:17.031634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:17.032344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:17.032631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:17.032911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:17.033527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:17.035139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:17.045397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 14:42:17.046490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 337/673] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 25 14:42:17 2021] GET /identity/v3/services/image => generated 86 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:17.053553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c610b5b-6343-418a-a178-6aed133231dc None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:17.062854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c610b5b-6343-418a-a178-6aed133231dc None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:17.066913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:17.067492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:17.067784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:17.068089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:17.068724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] RBAC: Adding query filter params (name=image) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:17.069017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:17.070617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:17.075789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 337/674] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:17 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:17.081265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:17.090580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77736744-9567-45ba-a08c-4dd0b451d0a4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:17.094694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d37ce4-2c3d-4fbe-a919-96122fcb1be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:17.095272 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d37ce4-2c3d-4fbe-a919-96122fcb1be2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:17.095561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d37ce4-2c3d-4fbe-a919-96122fcb1be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:17.095844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d37ce4-2c3d-4fbe-a919-96122fcb1be2 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:17.096510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d37ce4-2c3d-4fbe-a919-96122fcb1be2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:17.096809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d37ce4-2c3d-4fbe-a919-96122fcb1be2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:17.098374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d37ce4-2c3d-4fbe-a919-96122fcb1be2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:17.102992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 338/675] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:17 2021] GET /identity/v3/services?type=image => generated 350 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:17.108657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:17.117857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b72715-e6e4-4d61-816a-269ff6ee39aa admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:17.122419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1ff45-8f6a-4cb5-81e0-8149ee87c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:17.122993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ff45-8f6a-4cb5-81e0-8149ee87c7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:17.123278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ff45-8f6a-4cb5-81e0-8149ee87c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:17.123557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ff45-8f6a-4cb5-81e0-8149ee87c7b4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:17.124239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1ff45-8f6a-4cb5-81e0-8149ee87c7b4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:17.125790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1ff45-8f6a-4cb5-81e0-8149ee87c7b4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:17.143503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 338/676] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:42:17 2021] POST /identity/v3/endpoints => generated 327 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:42:19.227109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985cb6-fdf0-4ab6-ba88-908f027efdda None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:19.227603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985cb6-fdf0-4ab6-ba88-908f027efdda None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:19.227603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985cb6-fdf0-4ab6-ba88-908f027efdda None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:19.229236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 339/677] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:19.235155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34936679-713f-48da-a564-a5a6221ebd66 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:19.235570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34936679-713f-48da-a564-a5a6221ebd66 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:19.235725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34936679-713f-48da-a564-a5a6221ebd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:19.257805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-34936679-713f-48da-a564-a5a6221ebd66 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:19.258966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-34936679-713f-48da-a564-a5a6221ebd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:19.274999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 339/678] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:19 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:42:19.297864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d985cb6-fdf0-4ab6-ba88-908f027efdda None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:19.309467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d985cb6-fdf0-4ab6-ba88-908f027efdda None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:19.313406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724307d-9d88-423e-a4e1-dcc578b1ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:19.313972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724307d-9d88-423e-a4e1-dcc578b1ed1d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:19.314257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724307d-9d88-423e-a4e1-dcc578b1ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:19.314573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724307d-9d88-423e-a4e1-dcc578b1ed1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:19.322035 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724307d-9d88-423e-a4e1-dcc578b1ed1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:19.323798 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724307d-9d88-423e-a4e1-dcc578b1ed1d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:19.332516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 340/679] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:42:19 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:42:19.338192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34936679-713f-48da-a564-a5a6221ebd66 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:19.347258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34936679-713f-48da-a564-a5a6221ebd66 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:19.351427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bfa5c-de36-47ff-ae53-f43afb6e3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:19.352137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfa5c-de36-47ff-ae53-f43afb6e3cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:19.352425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfa5c-de36-47ff-ae53-f43afb6e3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:19.352706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfa5c-de36-47ff-ae53-f43afb6e3cb6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:19.353793 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bfa5c-de36-47ff-ae53-f43afb6e3cb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:19.355500 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bfa5c-de36-47ff-ae53-f43afb6e3cb6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:19.357581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 340/680] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:21.627142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619501b-130b-40ab-a748-7f44881b6e8a None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:21.627667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619501b-130b-40ab-a748-7f44881b6e8a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:21.627780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619501b-130b-40ab-a748-7f44881b6e8a None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:21.629369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 341/681] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:21.634316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740238dc-2afa-4153-b429-fca69e1de590 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:21.634732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740238dc-2afa-4153-b429-fca69e1de590 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:21.634896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740238dc-2afa-4153-b429-fca69e1de590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:21.656719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-740238dc-2afa-4153-b429-fca69e1de590 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:21.657837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-740238dc-2afa-4153-b429-fca69e1de590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:21.664689 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 341/682] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:21 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:42:21.689095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619501b-130b-40ab-a748-7f44881b6e8a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:21.701393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619501b-130b-40ab-a748-7f44881b6e8a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:21.705357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:21.706068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:21.706357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:21.706670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:21.719353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:21.721160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:21.737887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:21.739010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 342/683] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:21.744950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740238dc-2afa-4153-b429-fca69e1de590 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:21.754083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740238dc-2afa-4153-b429-fca69e1de590 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:21.758159 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6ac91-a6f8-4f7f-9946-3a54a9e0f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:21.758772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6ac91-a6f8-4f7f-9946-3a54a9e0f9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:21.759057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6ac91-a6f8-4f7f-9946-3a54a9e0f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:21.759334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6ac91-a6f8-4f7f-9946-3a54a9e0f9b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:21.760018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6ac91-a6f8-4f7f-9946-3a54a9e0f9b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:21.760311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6ac91-a6f8-4f7f-9946-3a54a9e0f9b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:21.761877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6ac91-a6f8-4f7f-9946-3a54a9e0f9b9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:21.774576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 342/684] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:21.780299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:21.789603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34481af7-018e-4256-82aa-2839b830b112 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:21.793871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ca58f-f87a-4867-b148-10e9891d9c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:21.794493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ca58f-f87a-4867-b148-10e9891d9c1e admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:21.794785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ca58f-f87a-4867-b148-10e9891d9c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:21.795072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ca58f-f87a-4867-b148-10e9891d9c1e admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:21.795716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ca58f-f87a-4867-b148-10e9891d9c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:21.797620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ca58f-f87a-4867-b148-10e9891d9c1e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:21.820464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 343/685] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:42:21 2021] POST /identity/v3/users => generated 248 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:42:23.920898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5520-1228-4788-995d-c917d23e9ed2 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:23.921415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5520-1228-4788-995d-c917d23e9ed2 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:23.921499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5520-1228-4788-995d-c917d23e9ed2 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:23.923161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 343/686] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:23.928503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae7a58-63bc-4247-ac1c-e5fbe4ace803 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:23.928868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae7a58-63bc-4247-ac1c-e5fbe4ace803 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:23.929068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae7a58-63bc-4247-ac1c-e5fbe4ace803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:23.950500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f7ae7a58-63bc-4247-ac1c-e5fbe4ace803 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:23.951650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f7ae7a58-63bc-4247-ac1c-e5fbe4ace803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:23.958686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 344/687] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:23 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:23.982535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5520-1228-4788-995d-c917d23e9ed2 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:23.994379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5520-1228-4788-995d-c917d23e9ed2 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:23.998323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee062e-3a37-4af7-b1e5-b84b6485acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:23.999054 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee062e-3a37-4af7-b1e5-b84b6485acf4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:23.999339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee062e-3a37-4af7-b1e5-b84b6485acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:23.999617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee062e-3a37-4af7-b1e5-b84b6485acf4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.010229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee062e-3a37-4af7-b1e5-b84b6485acf4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:42:24.016714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-97ee062e-3a37-4af7-b1e5-b84b6485acf4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:42:24.017809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 344/688] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:42:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:24.023891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae7a58-63bc-4247-ac1c-e5fbe4ace803 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.033104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae7a58-63bc-4247-ac1c-e5fbe4ace803 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.037241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.037828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.038116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.038423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.039134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:24.039433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.041016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.050018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 345/689] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:24.055594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee062e-3a37-4af7-b1e5-b84b6485acf4 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.065352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee062e-3a37-4af7-b1e5-b84b6485acf4 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.069480 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.070186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.070506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.070831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.081930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.083782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.101229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:24.102317 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 345/690] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:24.108915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.118288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d559d0c-136b-49aa-8bf1-b3c41b7bb59f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.122472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.123054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.123339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.123619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.124297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:24.124591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.126156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.138634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 346/691] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:24.143979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.153813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53fcc2-4592-4182-8968-24fe40b166d6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.157945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.158694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.158984 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.159267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.171677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.173655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.190991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 14:42:24.192053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 346/692] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:24.197653 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.207531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05e2a7-315c-4364-92de-c6c3137929f3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.211635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.212225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.212510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.212786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.213567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:24.213864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.216247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.249094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 347/693] 10.222.0.57 () {56 vars in 1158 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:24.254712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.264413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca4103-2fd4-41d7-8415-30d20519209d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.268466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d4e1c-92b8-44cc-ad5d-a24e62ce2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.269020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4e1c-92b8-44cc-ad5d-a24e62ce2afc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.269301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4e1c-92b8-44cc-ad5d-a24e62ce2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.269576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4e1c-92b8-44cc-ad5d-a24e62ce2afc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.276981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d4e1c-92b8-44cc-ad5d-a24e62ce2afc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.279322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d4e1c-92b8-44cc-ad5d-a24e62ce2afc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.287469 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 347/694] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:42:24.293014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.302293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb076ed-2601-4e5d-8cea-b2fceb1f241c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.306426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.307155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.307443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.307722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.319004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.320817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.339414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:24.341151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 348/695] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:24.347088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d4e1c-92b8-44cc-ad5d-a24e62ce2afc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.356522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d4e1c-92b8-44cc-ad5d-a24e62ce2afc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.361064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.361662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.361951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.362232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.362971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:24.363273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.364863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.377881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 348/696] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:24.383461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.393318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61316f0-096a-44b4-8e2e-2bf22cfade3c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.397416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.398125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.398426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.398721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.407665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.409593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.423093 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:42:24.424169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 349/697] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:24.430095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.439518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4048a9d-12bb-42c4-8ef6-82c780cca9cb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.443699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fcf4-54de-487b-a8e1-0efba5493170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.444279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fcf4-54de-487b-a8e1-0efba5493170 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.444572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fcf4-54de-487b-a8e1-0efba5493170 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.444859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fcf4-54de-487b-a8e1-0efba5493170 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.445600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2fcf4-54de-487b-a8e1-0efba5493170 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:24.445899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2fcf4-54de-487b-a8e1-0efba5493170 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.447765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2fcf4-54de-487b-a8e1-0efba5493170 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.461407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 349/698] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:24.468554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:24.477887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d35c32-60e6-4b28-b578-ef9f53820ff8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:24.481958 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f45e54-0a79-4796-82be-e8ca5c7cd60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:24.482565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f45e54-0a79-4796-82be-e8ca5c7cd60d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:24.482853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f45e54-0a79-4796-82be-e8ca5c7cd60d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:24.483127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f45e54-0a79-4796-82be-e8ca5c7cd60d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:24.484158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f45e54-0a79-4796-82be-e8ca5c7cd60d admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=29ed619258a14a148654f372f3a6a6b3) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:24.484458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f45e54-0a79-4796-82be-e8ca5c7cd60d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:24.486285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f45e54-0a79-4796-82be-e8ca5c7cd60d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:24.491860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 350/699] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:42:24 2021] GET /identity/v3/role_assignments?user.id=29ed619258a14a148654f372f3a6a6b3&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:26.568168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79f55-c92b-4c51-ba8c-1f958a079443 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.568694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79f55-c92b-4c51-ba8c-1f958a079443 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.568779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79f55-c92b-4c51-ba8c-1f958a079443 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.570387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 350/700] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:26.575391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6aa2a-03a2-443e-9d8d-11d888a5387f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.575836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6aa2a-03a2-443e-9d8d-11d888a5387f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.575962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6aa2a-03a2-443e-9d8d-11d888a5387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.597631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-46f6aa2a-03a2-443e-9d8d-11d888a5387f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:26.598797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-46f6aa2a-03a2-443e-9d8d-11d888a5387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:26.606182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 351/701] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:26 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:26.628878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79f55-c92b-4c51-ba8c-1f958a079443 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.640540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79f55-c92b-4c51-ba8c-1f958a079443 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:26.644509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a433f-aea3-4a50-9372-48df6f4fa95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:26.645220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a433f-aea3-4a50-9372-48df6f4fa95c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.645506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a433f-aea3-4a50-9372-48df6f4fa95c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.645783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a433f-aea3-4a50-9372-48df6f4fa95c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.656718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a433f-aea3-4a50-9372-48df6f4fa95c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:42:26.663267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-a34a433f-aea3-4a50-9372-48df6f4fa95c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:42:26.664359 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 351/702] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:26.670791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6aa2a-03a2-443e-9d8d-11d888a5387f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.679445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6aa2a-03a2-443e-9d8d-11d888a5387f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:26.683600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:26.684734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.685020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.685300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.686007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:26.686309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:26.688033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:26.696340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 352/703] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:26.702033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a433f-aea3-4a50-9372-48df6f4fa95c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.711688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a433f-aea3-4a50-9372-48df6f4fa95c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:26.715863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:26.716569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.716853 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.717127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.728151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:26.729970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:26.749106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:26.750191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 352/704] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:26.755989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.765346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2054b1-7532-4f5e-9c6f-88ef792b9247 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:26.769483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:26.770065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.770355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.770741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.771428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:26.771731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:26.773342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:26.786015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 353/705] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:26.791608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.801572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f0e1-f5af-4c6e-87e0-30a2e41c7aa7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:26.805662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:26.806378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.806694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.806976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.819345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:26.821284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:26.838669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 14:42:26.839750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 353/706] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:26.845875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.855348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f82de0-f64a-489b-8094-bb46e5711df8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:26.860424 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:26.861016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.861307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.861589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.862376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:26.862716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:26.864537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:26.892000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 354/707] 10.222.0.57 () {56 vars in 1158 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:26.897494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.907331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe2e1b-e499-4573-91d0-7cc9719cf37c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:26.911530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:26.912235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.912521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.912799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.925049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:26.926900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:26.943519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:26.944617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 354/708] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:42:26.950301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.959759 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade68b-f816-4c19-9453-8b92545cd6b4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:26.963925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:26.964512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:26.964799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:26.965571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:26.966259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:26.966588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:26.968185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:26.981305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 355/709] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:26.987370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:26.998587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77d832-51fa-488f-bdec-0c638242c760 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:27.002898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:27.003642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:27.003927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:27.004203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:27.013406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:27.015384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:27.030220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:42:27.031396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 355/710] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:42:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:27.037243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:27.047437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2155-5e3c-4c38-b3e5-529b6cf9b55e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:27.051703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ab250-abac-41a1-897d-7dd9a5d84f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:27.052294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab250-abac-41a1-897d-7dd9a5d84f5a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:27.052583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab250-abac-41a1-897d-7dd9a5d84f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:27.052868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab250-abac-41a1-897d-7dd9a5d84f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:27.053612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ab250-abac-41a1-897d-7dd9a5d84f5a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:27.053913 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ab250-abac-41a1-897d-7dd9a5d84f5a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:27.055804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ab250-abac-41a1-897d-7dd9a5d84f5a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:27.069730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 356/711] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:42:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:27.075569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:27.084790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98368532-a2eb-4d03-88f0-676b244fff00 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:27.088909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d4fe7-3d24-4ff1-9a8f-698899b72e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:27.089709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4fe7-3d24-4ff1-9a8f-698899b72e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:27.090523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4fe7-3d24-4ff1-9a8f-698899b72e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:27.090799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4fe7-3d24-4ff1-9a8f-698899b72e0f admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/29ed619258a14a148654f372f3a6a6b3/roles/7aaa6f36ae64405697ffb965e125aae6` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:27.113371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d4fe7-3d24-4ff1-9a8f-698899b72e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=29ed619258a14a148654f372f3a6a6b3, role_id=7aaa6f36ae64405697ffb965e125aae6)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:27.116000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d4fe7-3d24-4ff1-9a8f-698899b72e0f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:27.128299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 356/712] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:42:27 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/29ed619258a14a148654f372f3a6a6b3/roles/7aaa6f36ae64405697ffb965e125aae6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:42:29.188683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a587-1b98-4cbf-841b-7c5e5cfe19ed None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.189182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a587-1b98-4cbf-841b-7c5e5cfe19ed None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.189182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a587-1b98-4cbf-841b-7c5e5cfe19ed None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.190849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 357/713] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:29.195878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead1517-a4e7-4ced-a1af-2564bccd8c11 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.196270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead1517-a4e7-4ced-a1af-2564bccd8c11 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.196447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead1517-a4e7-4ced-a1af-2564bccd8c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.218371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-eead1517-a4e7-4ced-a1af-2564bccd8c11 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:29.219556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-eead1517-a4e7-4ced-a1af-2564bccd8c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:29.282071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 357/714] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:29 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:29.305460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a587-1b98-4cbf-841b-7c5e5cfe19ed None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.317245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a587-1b98-4cbf-841b-7c5e5cfe19ed None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.321183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f27c1-0db8-4aec-bd88-f1993a9ea520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.321897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f27c1-0db8-4aec-bd88-f1993a9ea520 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.322184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f27c1-0db8-4aec-bd88-f1993a9ea520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.322490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f27c1-0db8-4aec-bd88-f1993a9ea520 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.333433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f27c1-0db8-4aec-bd88-f1993a9ea520 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:42:29.340555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-8e4f27c1-0db8-4aec-bd88-f1993a9ea520 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:42:29.341656 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 358/715] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:29.347588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead1517-a4e7-4ced-a1af-2564bccd8c11 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.356928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead1517-a4e7-4ced-a1af-2564bccd8c11 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.361390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.361981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.362271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.362596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.363320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:29.363622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.365204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.373425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 358/716] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:29.378995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f27c1-0db8-4aec-bd88-f1993a9ea520 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.389470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f27c1-0db8-4aec-bd88-f1993a9ea520 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.393619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.394329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.394648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.394953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.406529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.408351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.425309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:29.426371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 359/717] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:29.435851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.445228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121f89c-90e4-41b9-b969-2704fda7527e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.449856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.450467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.450759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.451040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.451729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:29.452027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.453602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.466286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 359/718] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:29.471723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.481044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72727f07-c6f8-4f6b-8aa9-f84008c12f90 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.485454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.486170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.486491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.486773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.499096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.501082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.519307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 14:42:29.520376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 360/719] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:29.526086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.535919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d26bc-8920-4bd1-9512-795b5ce9b8e4 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.539992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.540579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.540866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.541146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.541932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:29.542266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.544097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.571495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 360/720] 10.222.0.57 () {56 vars in 1158 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:29.577537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.586797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011385e5-19fc-4886-a3d3-bb313eb7c6a4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.591451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d285fa8-5195-4d3f-9eaa-64261ebe6fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.592016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285fa8-5195-4d3f-9eaa-64261ebe6fff admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.592299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285fa8-5195-4d3f-9eaa-64261ebe6fff admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.592576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285fa8-5195-4d3f-9eaa-64261ebe6fff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.601173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d285fa8-5195-4d3f-9eaa-64261ebe6fff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.602978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d285fa8-5195-4d3f-9eaa-64261ebe6fff admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.612890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 361/721] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:42:29.618956 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.631341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb586-21d3-420b-b532-23c76f6cdf79 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.637660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.638610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.639044 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.639507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.652302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.655102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.672911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:42:29.674039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 361/722] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:29.679703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d285fa8-5195-4d3f-9eaa-64261ebe6fff admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.688593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d285fa8-5195-4d3f-9eaa-64261ebe6fff admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.692731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.693306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.693589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.693867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.694584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:29.694877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.696496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.709281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 362/723] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:29.715574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.724933 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbefc8a-e40a-4aef-8bfc-ea2f44cee25f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.729069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.729774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.730060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.730338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.740582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.742563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.756987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:42:29.758070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 362/724] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:29.764493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.773773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c6ee4-77be-4b0e-9516-8031e892abc1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.777884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a690a86-7522-41bc-b5f5-3d0e09adc053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.778481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a690a86-7522-41bc-b5f5-3d0e09adc053 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.778795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a690a86-7522-41bc-b5f5-3d0e09adc053 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.779072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a690a86-7522-41bc-b5f5-3d0e09adc053 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.779808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a690a86-7522-41bc-b5f5-3d0e09adc053 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:29.780108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a690a86-7522-41bc-b5f5-3d0e09adc053 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.781927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a690a86-7522-41bc-b5f5-3d0e09adc053 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.794625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 363/725] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:29.800878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:29.811059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08693f0-a0f8-4b59-845b-501275745059 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:29.815338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862b446-6237-48fe-bc75-f0d30035d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:29.815908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b446-6237-48fe-bc75-f0d30035d40d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:29.816197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b446-6237-48fe-bc75-f0d30035d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:29.816471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b446-6237-48fe-bc75-f0d30035d40d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:29.817239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b446-6237-48fe-bc75-f0d30035d40d admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=29ed619258a14a148654f372f3a6a6b3) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:29.817536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b446-6237-48fe-bc75-f0d30035d40d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:29.819487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b446-6237-48fe-bc75-f0d30035d40d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:29.826100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 363/726] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:42:29 2021] GET /identity/v3/role_assignments?user.id=29ed619258a14a148654f372f3a6a6b3&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:31.939281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b60f7-8a75-408d-b0ae-87d76d55ab28 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:31.939833 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b60f7-8a75-408d-b0ae-87d76d55ab28 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:31.939833 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b60f7-8a75-408d-b0ae-87d76d55ab28 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:31.941517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 364/727] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:31.946696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd6eb-ad77-4197-8991-0b1fc926dd1e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:31.947098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd6eb-ad77-4197-8991-0b1fc926dd1e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:31.947261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd6eb-ad77-4197-8991-0b1fc926dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:31.969005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c6fdd6eb-ad77-4197-8991-0b1fc926dd1e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:31.970160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c6fdd6eb-ad77-4197-8991-0b1fc926dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:31.977065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 364/728] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:31 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:42:32.000259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b60f7-8a75-408d-b0ae-87d76d55ab28 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:32.011868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b60f7-8a75-408d-b0ae-87d76d55ab28 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:32.015814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:32.016538 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:32.016821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:32.017095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:32.017706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:32.019309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:32.030379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 14:42:32.031441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 365/729] 10.222.0.57 () {56 vars in 1150 bytes} [Mon Oct 25 14:42:31 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:32.037270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdd6eb-ad77-4197-8991-0b1fc926dd1e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:32.046671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdd6eb-ad77-4197-8991-0b1fc926dd1e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:32.050808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d5bf3-02a6-4160-9527-fc3105b756ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:32.051390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5bf3-02a6-4160-9527-fc3105b756ea admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:32.051675 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5bf3-02a6-4160-9527-fc3105b756ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:32.051953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5bf3-02a6-4160-9527-fc3105b756ea admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:32.052622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d5bf3-02a6-4160-9527-fc3105b756ea admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:32.052917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d5bf3-02a6-4160-9527-fc3105b756ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:32.054509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d5bf3-02a6-4160-9527-fc3105b756ea admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:32.058917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 365/730] 10.222.0.57 () {56 vars in 1145 bytes} [Mon Oct 25 14:42:32 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:32.064419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:32.073693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2699d-edbc-4dfb-89d3-fec83c7c1300 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:32.077689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bf202-bc26-45c0-8c8c-34bdf45a1d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:32.078273 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf202-bc26-45c0-8c8c-34bdf45a1d4b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:32.078592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf202-bc26-45c0-8c8c-34bdf45a1d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:32.078869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf202-bc26-45c0-8c8c-34bdf45a1d4b admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:32.079526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bf202-bc26-45c0-8c8c-34bdf45a1d4b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:32.079820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bf202-bc26-45c0-8c8c-34bdf45a1d4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:32.081372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bf202-bc26-45c0-8c8c-34bdf45a1d4b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:32.085769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 366/731] 10.222.0.57 () {56 vars in 1145 bytes} [Mon Oct 25 14:42:32 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:34.152998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f700c-0420-4df5-8821-b57dd262dfc1 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:34.153541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f700c-0420-4df5-8821-b57dd262dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:34.153541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f700c-0420-4df5-8821-b57dd262dfc1 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:34.155188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 366/732] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:34.160410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d564c-5e92-4e5a-8a97-f3fbe1920e04 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:34.160834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d564c-5e92-4e5a-8a97-f3fbe1920e04 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:34.160978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d564c-5e92-4e5a-8a97-f3fbe1920e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:34.183026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-4a5d564c-5e92-4e5a-8a97-f3fbe1920e04 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:34.184795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4a5d564c-5e92-4e5a-8a97-f3fbe1920e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:34.191669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 367/733] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:34 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:34.213850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f700c-0420-4df5-8821-b57dd262dfc1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:34.225373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f700c-0420-4df5-8821-b57dd262dfc1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:34.229278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9400-b9b7-4a0d-a9de-922d1b5d0b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:34.229844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9400-b9b7-4a0d-a9de-922d1b5d0b75 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:34.230126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9400-b9b7-4a0d-a9de-922d1b5d0b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:34.230924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9400-b9b7-4a0d-a9de-922d1b5d0b75 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:34.231597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c9400-b9b7-4a0d-a9de-922d1b5d0b75 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:34.233148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c9400-b9b7-4a0d-a9de-922d1b5d0b75 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:34.246737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 367/734] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:42:34 2021] POST /identity/v3/services => generated 251 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:42:36.329134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a924-ad7e-4e35-9e4d-4cebdd7f55ea None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:36.329686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a924-ad7e-4e35-9e4d-4cebdd7f55ea None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:36.329686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a924-ad7e-4e35-9e4d-4cebdd7f55ea None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:36.331392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 368/735] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:36.336638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc31186-e631-41e5-8036-4604c69b7fa0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:36.337069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc31186-e631-41e5-8036-4604c69b7fa0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:36.337193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc31186-e631-41e5-8036-4604c69b7fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:36.359303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1bc31186-e631-41e5-8036-4604c69b7fa0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:36.360428 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1bc31186-e631-41e5-8036-4604c69b7fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:36.377029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 368/736] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:36 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:36.399353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04a924-ad7e-4e35-9e4d-4cebdd7f55ea None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:36.411602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04a924-ad7e-4e35-9e4d-4cebdd7f55ea None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:36.415568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:36.416296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:36.416584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:36.416866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:36.417484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:36.419138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:36.429860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 14:42:36.430965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 369/737] 10.222.0.57 () {56 vars in 1150 bytes} [Mon Oct 25 14:42:36 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:36.436885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc31186-e631-41e5-8036-4604c69b7fa0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:36.445447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc31186-e631-41e5-8036-4604c69b7fa0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:36.450122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:36.450765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:36.451054 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:36.451332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:36.452005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:36.452302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:36.453863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:36.458312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 369/738] 10.222.0.57 () {56 vars in 1145 bytes} [Mon Oct 25 14:42:36 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:36.463842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:36.473575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268b84-338c-4838-81d8-7f89a9b0c4af admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:36.477625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:36.478194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:36.478517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:36.478797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:36.479456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:36.479749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:36.481301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:36.485998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 370/739] 10.222.0.57 () {56 vars in 1145 bytes} [Mon Oct 25 14:42:36 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:36.491686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:36.501318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8ea77-5194-4551-bf8f-ca3b65d9370d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:36.505462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5d340-74f1-4559-bd74-8102a1e60dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:36.506031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5d340-74f1-4559-bd74-8102a1e60dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:36.506318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5d340-74f1-4559-bd74-8102a1e60dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:36.506635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5d340-74f1-4559-bd74-8102a1e60dd9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:36.507380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5d340-74f1-4559-bd74-8102a1e60dd9 admin admin] RBAC: Adding query filter params (interface=public, service_id=41dc5f1f61884b88bd145641e5eda27a, region_id=RegionOne) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:36.507686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5d340-74f1-4559-bd74-8102a1e60dd9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:36.509238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5d340-74f1-4559-bd74-8102a1e60dd9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:36.514849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 370/740] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:42:36 2021] GET /identity/v3/endpoints?service_id=41dc5f1f61884b88bd145641e5eda27a&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:36.519915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:36.528947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8792-65ed-43ff-9685-3c642929ffad admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:36.532992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821856c-31f0-4061-935e-792a12f0db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:36.533559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821856c-31f0-4061-935e-792a12f0db18 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:36.533841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821856c-31f0-4061-935e-792a12f0db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:36.534118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821856c-31f0-4061-935e-792a12f0db18 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:36.534788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821856c-31f0-4061-935e-792a12f0db18 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:36.536342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821856c-31f0-4061-935e-792a12f0db18 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:36.541687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 371/741] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:42:36 2021] GET /identity/v3/services => generated 1261 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:42:38.648409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df578e-260d-4331-9c43-dac979ccbe74 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:38.648932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df578e-260d-4331-9c43-dac979ccbe74 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:38.649082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df578e-260d-4331-9c43-dac979ccbe74 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:38.650683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 371/742] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:38.656364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9085-331c-47b8-bd82-4a3ef195e1e1 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:38.656739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9085-331c-47b8-bd82-4a3ef195e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:38.656933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9085-331c-47b8-bd82-4a3ef195e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:38.678652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-46fe9085-331c-47b8-bd82-4a3ef195e1e1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:38.679792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-46fe9085-331c-47b8-bd82-4a3ef195e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:38.686824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 372/743] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:38 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:38.709586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df578e-260d-4331-9c43-dac979ccbe74 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:38.721846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df578e-260d-4331-9c43-dac979ccbe74 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:38.725835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:38.726594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:38.726886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:38.727168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:38.727790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:38.729363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:38.740402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 14:42:38.741464 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 372/744] 10.222.0.57 () {56 vars in 1150 bytes} [Mon Oct 25 14:42:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:38.747928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe9085-331c-47b8-bd82-4a3ef195e1e1 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:38.756516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe9085-331c-47b8-bd82-4a3ef195e1e1 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:38.760718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:38.761935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:38.762222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:38.762537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:38.763205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:38.763501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:38.765062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:38.769465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 373/745] 10.222.0.57 () {56 vars in 1145 bytes} [Mon Oct 25 14:42:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:38.774890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:38.784171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a63b2-1739-49b2-9550-601cae47dd19 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:38.788394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52171a3-d626-4b4f-b10b-4b18b5a170ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:38.788959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52171a3-d626-4b4f-b10b-4b18b5a170ec admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:38.789246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52171a3-d626-4b4f-b10b-4b18b5a170ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:38.789527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52171a3-d626-4b4f-b10b-4b18b5a170ec admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:38.790206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52171a3-d626-4b4f-b10b-4b18b5a170ec admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:38.790552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52171a3-d626-4b4f-b10b-4b18b5a170ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:38.792187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52171a3-d626-4b4f-b10b-4b18b5a170ec admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:38.797027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 373/746] 10.222.0.57 () {56 vars in 1145 bytes} [Mon Oct 25 14:42:38 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:38.802787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:38.812587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bbcea-e7f2-4c5d-94f7-3ddc2d6948ba admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:38.816811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a3fcf-6902-4f56-96db-203752320638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:38.817484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a3fcf-6902-4f56-96db-203752320638 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:38.817834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a3fcf-6902-4f56-96db-203752320638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:38.818181 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a3fcf-6902-4f56-96db-203752320638 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:38.818975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a3fcf-6902-4f56-96db-203752320638 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:38.820610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a3fcf-6902-4f56-96db-203752320638 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:38.838799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 374/747] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:42:38 2021] POST /identity/v3/endpoints => generated 346 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:42:40.950888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d62d4-d019-48ae-a0f8-f8af7726af0f None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:40.951434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d62d4-d019-48ae-a0f8-f8af7726af0f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:40.951434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d62d4-d019-48ae-a0f8-f8af7726af0f None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:40.953091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 374/748] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:40.958672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3282-7e97-4ef0-b515-be00b0cc5c87 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:40.959082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3282-7e97-4ef0-b515-be00b0cc5c87 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:40.959230 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3282-7e97-4ef0-b515-be00b0cc5c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:40.981204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-361b3282-7e97-4ef0-b515-be00b0cc5c87 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:40.982321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-361b3282-7e97-4ef0-b515-be00b0cc5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:40.999355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 375/749] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:40 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:41.022113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d62d4-d019-48ae-a0f8-f8af7726af0f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:41.033930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d62d4-d019-48ae-a0f8-f8af7726af0f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:41.037936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:41.038679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:41.038973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:41.039253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:41.039871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:41.041435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:41.052066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 25 14:42:41.053115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 375/750] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:41 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:41.059640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b3282-7e97-4ef0-b515-be00b0cc5c87 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:41.068254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b3282-7e97-4ef0-b515-be00b0cc5c87 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:41.072497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b1276-c163-4f8a-b977-faecc6b45e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:41.073029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1276-c163-4f8a-b977-faecc6b45e48 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:41.073317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1276-c163-4f8a-b977-faecc6b45e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:41.073598 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1276-c163-4f8a-b977-faecc6b45e48 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:41.074906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b1276-c163-4f8a-b977-faecc6b45e48 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:41.075206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b1276-c163-4f8a-b977-faecc6b45e48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:41.076791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b1276-c163-4f8a-b977-faecc6b45e48 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:41.081366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 376/751] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:41 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:41.086893 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:41.097074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47825-3423-486e-897f-8a14b7b2162f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:41.101261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a54bd-1dda-4627-ab15-899fac04c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:41.101836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a54bd-1dda-4627-ab15-899fac04c955 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:41.102124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a54bd-1dda-4627-ab15-899fac04c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:41.102425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a54bd-1dda-4627-ab15-899fac04c955 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:41.103101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a54bd-1dda-4627-ab15-899fac04c955 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:41.103399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a54bd-1dda-4627-ab15-899fac04c955 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:41.104954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a54bd-1dda-4627-ab15-899fac04c955 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:41.110572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 376/752] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:41 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:43.156046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17a657-75ce-4fe1-98d3-cbf13f0ab984 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:43.156558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17a657-75ce-4fe1-98d3-cbf13f0ab984 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:43.156558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17a657-75ce-4fe1-98d3-cbf13f0ab984 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:43.158248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 377/753] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:43.163492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05de88-eb5d-406b-bb17-2ffee3b18f70 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:43.163938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05de88-eb5d-406b-bb17-2ffee3b18f70 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:43.164035 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05de88-eb5d-406b-bb17-2ffee3b18f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:43.186462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4a05de88-eb5d-406b-bb17-2ffee3b18f70 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:43.187585 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4a05de88-eb5d-406b-bb17-2ffee3b18f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:43.194344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 377/754] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:43 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:43.216453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17a657-75ce-4fe1-98d3-cbf13f0ab984 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:43.231350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17a657-75ce-4fe1-98d3-cbf13f0ab984 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:43.235671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a60d-2c88-4c11-95aa-24a095f42355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:43.236252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a60d-2c88-4c11-95aa-24a095f42355 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:43.236537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a60d-2c88-4c11-95aa-24a095f42355 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:43.236814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a60d-2c88-4c11-95aa-24a095f42355 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:43.237494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637a60d-2c88-4c11-95aa-24a095f42355 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:43.239118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637a60d-2c88-4c11-95aa-24a095f42355 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:43.253289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 378/755] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:42:43 2021] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:42:45.349957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b28fab-4729-4e32-b733-d5d88d186f9e None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:45.350530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b28fab-4729-4e32-b733-d5d88d186f9e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:45.350530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b28fab-4729-4e32-b733-d5d88d186f9e None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:45.352202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 378/756] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:45.358021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b0013-f86c-4d8b-802d-97ab6a3df23c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:45.358755 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b0013-f86c-4d8b-802d-97ab6a3df23c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:45.358877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b0013-f86c-4d8b-802d-97ab6a3df23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:45.385077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-051b0013-f86c-4d8b-802d-97ab6a3df23c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:45.386263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-051b0013-f86c-4d8b-802d-97ab6a3df23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:45.402949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 379/757] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:45 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:45.424981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b28fab-4729-4e32-b733-d5d88d186f9e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:45.437108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b28fab-4729-4e32-b733-d5d88d186f9e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:45.441048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:45.441753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:45.442036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:45.442312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:45.442964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:45.444524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:45.454749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 25 14:42:45.455794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 379/758] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:45 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:45.461687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b0013-f86c-4d8b-802d-97ab6a3df23c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:45.470338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b0013-f86c-4d8b-802d-97ab6a3df23c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:45.474550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:45.475137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:45.475426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:45.475707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:45.476377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:45.476678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:45.478258 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:45.483610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 380/759] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:45 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:45.488995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:45.499018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b8b19-250b-4577-9043-0dea447753c0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:45.503212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:45.503784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:45.504067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:45.504346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:45.505014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:45.505311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:45.506915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:45.511549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 380/760] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:45 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:45.517149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:45.526341 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a261ea-aa43-446e-9d6e-4d7fda0ea34b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:45.531040 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678083-c965-4f91-a59e-50321bac9e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:45.531611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678083-c965-4f91-a59e-50321bac9e3a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:45.531896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678083-c965-4f91-a59e-50321bac9e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:45.532173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678083-c965-4f91-a59e-50321bac9e3a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:45.532911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678083-c965-4f91-a59e-50321bac9e3a admin admin] RBAC: Adding query filter params (interface=public, service_id=307630001dd8401fb4b96e0ce9b0a9ff, region_id=RegionOne) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:45.533210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678083-c965-4f91-a59e-50321bac9e3a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:45.534820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678083-c965-4f91-a59e-50321bac9e3a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:45.539822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 381/761] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:42:45 2021] GET /identity/v3/endpoints?service_id=307630001dd8401fb4b96e0ce9b0a9ff&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:45.545776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:45.554959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaca00-c30c-433e-8bdd-726952fe14a6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:45.559156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ce983-5d65-4c28-9204-c20ae86a8b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:45.559731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce983-5d65-4c28-9204-c20ae86a8b8f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:45.560016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce983-5d65-4c28-9204-c20ae86a8b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:45.560295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce983-5d65-4c28-9204-c20ae86a8b8f admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:45.560942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ce983-5d65-4c28-9204-c20ae86a8b8f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:45.562536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ce983-5d65-4c28-9204-c20ae86a8b8f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:45.568263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 381/762] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:42:45 2021] GET /identity/v3/services => generated 1500 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:42:47.629088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0af92-08f9-4207-8725-4472020c6120 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:47.629643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0af92-08f9-4207-8725-4472020c6120 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:47.629643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0af92-08f9-4207-8725-4472020c6120 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:47.631368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 382/763] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:47.636890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf582b-177e-44c9-9f1c-6fb2346813bd None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:47.637282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf582b-177e-44c9-9f1c-6fb2346813bd None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:47.637442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf582b-177e-44c9-9f1c-6fb2346813bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:47.659463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7caf582b-177e-44c9-9f1c-6fb2346813bd None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:47.660596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7caf582b-177e-44c9-9f1c-6fb2346813bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:47.667440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 382/764] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:47 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:47.689326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0af92-08f9-4207-8725-4472020c6120 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:47.701446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0af92-08f9-4207-8725-4472020c6120 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:47.705504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:47.706217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:47.706536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:47.706814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:47.707427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:47.708990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:47.719932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 25 14:42:47.720978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 383/765] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:47 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:47.726609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf582b-177e-44c9-9f1c-6fb2346813bd None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:47.735389 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf582b-177e-44c9-9f1c-6fb2346813bd None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:47.739568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:47.740135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:47.740420 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:47.740697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:47.741362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:47.741657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:47.743232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:47.748234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 383/766] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:47 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:47.753712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:47.763647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd834550-c5c9-491c-aba1-5b6f5a79c4c9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:47.767729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd4750-86d2-4f14-9d15-7051e180c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:47.768300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4750-86d2-4f14-9d15-7051e180c29b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:47.768585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4750-86d2-4f14-9d15-7051e180c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:47.768864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4750-86d2-4f14-9d15-7051e180c29b admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:47.769524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd4750-86d2-4f14-9d15-7051e180c29b admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:47.769819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd4750-86d2-4f14-9d15-7051e180c29b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:47.771419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd4750-86d2-4f14-9d15-7051e180c29b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:47.775972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 384/767] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:47 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:47.781389 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:47.790666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49959105-5778-4a25-b550-1cff8f47807c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:47.794943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36081a4-1109-42ab-bfca-446b5f38e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:47.795533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36081a4-1109-42ab-bfca-446b5f38e33d admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:47.795829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36081a4-1109-42ab-bfca-446b5f38e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:47.796113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36081a4-1109-42ab-bfca-446b5f38e33d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:47.796810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36081a4-1109-42ab-bfca-446b5f38e33d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:47.798378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36081a4-1109-42ab-bfca-446b5f38e33d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:47.816875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 384/768] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:42:47 2021] POST /identity/v3/endpoints => generated 346 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:42:49.905927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8bee-d2a5-49d6-9876-a199eb81d5c4 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:49.906472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8bee-d2a5-49d6-9876-a199eb81d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:49.906564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8bee-d2a5-49d6-9876-a199eb81d5c4 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:49.908160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 385/769] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:49.913362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abce03-d904-4ba7-9d8a-6705efd91ac3 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:49.913792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abce03-d904-4ba7-9d8a-6705efd91ac3 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:49.913939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abce03-d904-4ba7-9d8a-6705efd91ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:49.936630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-89abce03-d904-4ba7-9d8a-6705efd91ac3 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:49.937783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-89abce03-d904-4ba7-9d8a-6705efd91ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:49.954568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 385/770] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:49 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:49.976177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8bee-d2a5-49d6-9876-a199eb81d5c4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:49.988526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8bee-d2a5-49d6-9876-a199eb81d5c4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:49.992512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:49.993228 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:49.993523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:49.993805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:49.994446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:49.996654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:50.007000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 14:42:50.008042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 386/771] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:49 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:50.013795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abce03-d904-4ba7-9d8a-6705efd91ac3 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:50.022387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abce03-d904-4ba7-9d8a-6705efd91ac3 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:50.027075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be22b7-bfb6-4b14-a19f-52cea172957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:50.027661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be22b7-bfb6-4b14-a19f-52cea172957b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:50.027955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be22b7-bfb6-4b14-a19f-52cea172957b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:50.028237 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be22b7-bfb6-4b14-a19f-52cea172957b admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:50.028912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be22b7-bfb6-4b14-a19f-52cea172957b admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:50.029212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be22b7-bfb6-4b14-a19f-52cea172957b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:50.030827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be22b7-bfb6-4b14-a19f-52cea172957b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:50.037387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 386/772] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:50 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:50.043688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:50.053418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf82331-7caf-43be-8cb3-1492334e4d1c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:50.057514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fae7d-adee-4490-9427-7daa34814b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:50.058088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fae7d-adee-4490-9427-7daa34814b7e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:50.058375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fae7d-adee-4490-9427-7daa34814b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:50.058688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fae7d-adee-4490-9427-7daa34814b7e admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:50.059508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fae7d-adee-4490-9427-7daa34814b7e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:50.059651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fae7d-adee-4490-9427-7daa34814b7e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:50.061214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fae7d-adee-4490-9427-7daa34814b7e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:50.065399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 387/773] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:50 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:52.128794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1a83-c823-4f51-b303-fe4d9794fa34 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:52.129289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1a83-c823-4f51-b303-fe4d9794fa34 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:52.129289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1a83-c823-4f51-b303-fe4d9794fa34 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:52.130975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 387/774] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:52.136649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034a45-03e4-4132-bda2-05c8a7362647 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:52.137047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034a45-03e4-4132-bda2-05c8a7362647 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:52.137199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034a45-03e4-4132-bda2-05c8a7362647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:52.159551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-94034a45-03e4-4132-bda2-05c8a7362647 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:52.160695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-94034a45-03e4-4132-bda2-05c8a7362647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:52.167609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 388/775] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:52 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:52.189661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1a83-c823-4f51-b303-fe4d9794fa34 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:52.201873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1a83-c823-4f51-b303-fe4d9794fa34 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:52.205902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74e5cc-0573-47fc-b24c-fe90df477feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:52.206507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e5cc-0573-47fc-b24c-fe90df477feb admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:52.206799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e5cc-0573-47fc-b24c-fe90df477feb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:52.207080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e5cc-0573-47fc-b24c-fe90df477feb admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:52.207751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74e5cc-0573-47fc-b24c-fe90df477feb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:52.209329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74e5cc-0573-47fc-b24c-fe90df477feb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:52.222248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 388/776] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:42:52 2021] POST /identity/v3/services => generated 251 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:42:54.294047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c060-6f05-4d3c-b8cd-d59faf3aee31 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:54.294584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c060-6f05-4d3c-b8cd-d59faf3aee31 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:54.294675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c060-6f05-4d3c-b8cd-d59faf3aee31 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:54.296317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 389/777] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:54.301604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881a6d-adb4-4211-9cc0-9be9c2b2f7dc None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:54.302017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881a6d-adb4-4211-9cc0-9be9c2b2f7dc None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:54.302156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881a6d-adb4-4211-9cc0-9be9c2b2f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:54.324041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-24881a6d-adb4-4211-9cc0-9be9c2b2f7dc None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:54.325159 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-24881a6d-adb4-4211-9cc0-9be9c2b2f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:54.341976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 389/778] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:54 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:42:54.364022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c060-6f05-4d3c-b8cd-d59faf3aee31 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:54.375486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c060-6f05-4d3c-b8cd-d59faf3aee31 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:54.379389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:54.380109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:54.380390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:54.380666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:54.381282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:54.382904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:54.393629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 14:42:54.394731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 390/779] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:54 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:54.401124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24881a6d-adb4-4211-9cc0-9be9c2b2f7dc None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:54.410333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24881a6d-adb4-4211-9cc0-9be9c2b2f7dc None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:54.414565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:54.415148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:54.415436 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:54.415718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:54.416403 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:54.416706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:54.418477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:54.423069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 390/780] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:54 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:54.428434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:54.437569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba5935-cafd-403d-8ea3-28313bea747c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:54.441634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:54.442215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:54.442525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:54.442804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:54.443467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:54.443760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:54.445313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:54.451446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 391/781] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:54 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:42:54.457427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:54.467371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41a1e-70a2-4145-bf33-e084c670d1a6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:54.471544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1df6b-3751-4cf1-82b1-38e47bc26211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:54.472117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1df6b-3751-4cf1-82b1-38e47bc26211 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:54.472405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1df6b-3751-4cf1-82b1-38e47bc26211 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:54.472685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1df6b-3751-4cf1-82b1-38e47bc26211 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:54.473462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1df6b-3751-4cf1-82b1-38e47bc26211 admin admin] RBAC: Adding query filter params (interface=public, service_id=1d1dbf379eab4200bf28f52978c794af, region_id=RegionOne) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:54.473766 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1df6b-3751-4cf1-82b1-38e47bc26211 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:54.475376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1df6b-3751-4cf1-82b1-38e47bc26211 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:54.480518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 391/782] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:42:54 2021] GET /identity/v3/endpoints?service_id=1d1dbf379eab4200bf28f52978c794af&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:54.486085 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:54.495629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3279dc6-8fb5-458d-aa04-2e0dc54f41b1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:54.499707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5edff-2b4c-469a-b15c-0167d4a2c247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:54.500311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5edff-2b4c-469a-b15c-0167d4a2c247 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:54.500593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5edff-2b4c-469a-b15c-0167d4a2c247 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:54.500866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5edff-2b4c-469a-b15c-0167d4a2c247 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:54.501499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5edff-2b4c-469a-b15c-0167d4a2c247 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:54.503098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5edff-2b4c-469a-b15c-0167d4a2c247 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:54.509057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 392/783] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:42:54 2021] GET /identity/v3/services => generated 1739 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:42:56.588287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38761-7640-4020-9145-fc6942040b5a None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:56.588884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38761-7640-4020-9145-fc6942040b5a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:56.588884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38761-7640-4020-9145-fc6942040b5a None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:56.590625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 392/784] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:56.595996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d8699-9e20-4e95-86f3-2eef7cd373c2 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:56.596380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d8699-9e20-4e95-86f3-2eef7cd373c2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:56.596555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d8699-9e20-4e95-86f3-2eef7cd373c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:56.619312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-981d8699-9e20-4e95-86f3-2eef7cd373c2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:56.620459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-981d8699-9e20-4e95-86f3-2eef7cd373c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:56.627344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 393/785] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:56 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:56.650021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38761-7640-4020-9145-fc6942040b5a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:56.662476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38761-7640-4020-9145-fc6942040b5a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:56.666461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:56.667246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:56.667533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:56.667810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:56.668426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:56.669982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:56.680195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 14:42:56.681244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 393/786] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:56.687213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d8699-9e20-4e95-86f3-2eef7cd373c2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:56.695869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d8699-9e20-4e95-86f3-2eef7cd373c2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:56.700532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:56.701120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:56.701404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:56.701682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:56.702351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:56.702680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:56.704244 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:56.708863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 394/787] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:56.714918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:56.724026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428bd89-b093-4b50-8bba-c5ba140d1a30 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:56.728175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5013b1-4be3-4523-9252-aa72f153d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:56.728744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5013b1-4be3-4523-9252-aa72f153d58c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:56.729030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5013b1-4be3-4523-9252-aa72f153d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:56.729309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5013b1-4be3-4523-9252-aa72f153d58c admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:56.729974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5013b1-4be3-4523-9252-aa72f153d58c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:56.730272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5013b1-4be3-4523-9252-aa72f153d58c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:56.731851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5013b1-4be3-4523-9252-aa72f153d58c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:56.736625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 394/788] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:42:56 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:42:56.742118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:56.751750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd9551-f102-4477-af51-786fc072051d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:56.755787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4316a-5c99-48b2-90a9-d0fb1fe087f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:56.756358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4316a-5c99-48b2-90a9-d0fb1fe087f8 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:56.756641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4316a-5c99-48b2-90a9-d0fb1fe087f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:56.756916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4316a-5c99-48b2-90a9-d0fb1fe087f8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:56.757604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4316a-5c99-48b2-90a9-d0fb1fe087f8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:56.759201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4316a-5c99-48b2-90a9-d0fb1fe087f8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:56.777205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 395/789] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:42:56 2021] POST /identity/v3/endpoints => generated 346 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:42:58.867873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b480-1117-48f4-829a-438bf5c565fa None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:58.868386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b480-1117-48f4-829a-438bf5c565fa None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:58.868474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b480-1117-48f4-829a-438bf5c565fa None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:58.870714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 395/790] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:42:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:42:58.875904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78402435-c1d7-4525-adb2-fb4b1e038cb6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:58.876345 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78402435-c1d7-4525-adb2-fb4b1e038cb6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:58.876462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78402435-c1d7-4525-adb2-fb4b1e038cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:58.897821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-78402435-c1d7-4525-adb2-fb4b1e038cb6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:42:58.898967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-78402435-c1d7-4525-adb2-fb4b1e038cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:42:58.915438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 396/791] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:42:58 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:42:58.939477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5b480-1117-48f4-829a-438bf5c565fa None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:58.951213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5b480-1117-48f4-829a-438bf5c565fa None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:58.955459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:58.955825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:58.956113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:58.956394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:58.957038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:58.958899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:58.960229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.common [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 25 14:42:58.978106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.sql.core [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 25 14:42:58.978106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 14:42:58.978106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [parameters: {'id': '44895de38feb4ef89b5a401e6dacdcdf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 25 14:42:58.978106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66563) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 25 14:42:58.992395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44895de38feb4ef89b5a401e6dacdcdf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44895de38feb4ef89b5a401e6dacdcdf. Oct 25 14:42:58.993628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 396/792] 10.222.0.57 () {60 vars in 1161 bytes} [Mon Oct 25 14:42:58 2021] POST /identity/v3/projects => generated 262 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:59.000320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78402435-c1d7-4525-adb2-fb4b1e038cb6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:59.008964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78402435-c1d7-4525-adb2-fb4b1e038cb6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:59.013245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6af5-7cf0-446e-b489-a28b125c1c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:59.013966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6af5-7cf0-446e-b489-a28b125c1c1b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:59.014252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6af5-7cf0-446e-b489-a28b125c1c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:59.014565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6af5-7cf0-446e-b489-a28b125c1c1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:59.022458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6af5-7cf0-446e-b489-a28b125c1c1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:59.024388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6af5-7cf0-446e-b489-a28b125c1c1b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:59.038632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-cc8b6af5-7cf0-446e-b489-a28b125c1c1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:42:59.039698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 397/793] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:42:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:42:59.046233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:42:59.056022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bcef2-a090-4843-82a9-622b5e93d458 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:42:59.060285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132eff9-bdeb-48ee-9c84-afa004b86f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:42:59.060863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132eff9-bdeb-48ee-9c84-afa004b86f32 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:42:59.061152 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132eff9-bdeb-48ee-9c84-afa004b86f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:42:59.061435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132eff9-bdeb-48ee-9c84-afa004b86f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:42:59.062153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132eff9-bdeb-48ee-9c84-afa004b86f32 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:42:59.062487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132eff9-bdeb-48ee-9c84-afa004b86f32 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:42:59.064782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132eff9-bdeb-48ee-9c84-afa004b86f32 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:42:59.081177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 397/794] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:42:59 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:01.187804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde27f56-d2aa-423b-9e2d-5f370b3e5c2e None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:01.188304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde27f56-d2aa-423b-9e2d-5f370b3e5c2e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:01.188304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde27f56-d2aa-423b-9e2d-5f370b3e5c2e None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:01.189953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 398/795] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:01.195226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e5bb-3c27-4765-b11a-58b8127520d9 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:01.195604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e5bb-3c27-4765-b11a-58b8127520d9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:01.195798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e5bb-3c27-4765-b11a-58b8127520d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:01.217750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6109e5bb-3c27-4765-b11a-58b8127520d9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:01.219241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6109e5bb-3c27-4765-b11a-58b8127520d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:01.226206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 398/796] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:01 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:01.251546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde27f56-d2aa-423b-9e2d-5f370b3e5c2e None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:01.263230 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde27f56-d2aa-423b-9e2d-5f370b3e5c2e None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:01.267244 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:01.267837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:01.268126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:01.268409 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:01.269068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:01.270929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:01.272210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.common [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 25 14:43:01.284347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.sql.core [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 25 14:43:01.284347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 25 14:43:01.284347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [parameters: {'user_id': 'c1a7d7de98274703be15cd8038259f3e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 25 14:43:01.284347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66562) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 25 14:43:01.297735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 25 14:43:01.298972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 399/797] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:43:01 2021] POST /identity/v3/users => generated 160 bytes in 48 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:01.305114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e5bb-3c27-4765-b11a-58b8127520d9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:01.313823 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e5bb-3c27-4765-b11a-58b8127520d9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:01.318007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539268b-58e2-4026-89eb-4e88714cd73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:01.318761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539268b-58e2-4026-89eb-4e88714cd73e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:01.319050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539268b-58e2-4026-89eb-4e88714cd73e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:01.319329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539268b-58e2-4026-89eb-4e88714cd73e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:01.331841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539268b-58e2-4026-89eb-4e88714cd73e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:01.333847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539268b-58e2-4026-89eb-4e88714cd73e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:01.352075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-d539268b-58e2-4026-89eb-4e88714cd73e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 14:43:01.353215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 399/798] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:43:01 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:01.362447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:01.374436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcf89-380b-4391-bdfb-9ac272e6b57a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:01.378978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d90521-2164-42b2-acbd-d835f9e44f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:01.379582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d90521-2164-42b2-acbd-d835f9e44f70 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:01.379866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d90521-2164-42b2-acbd-d835f9e44f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:01.380146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d90521-2164-42b2-acbd-d835f9e44f70 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:01.380900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d90521-2164-42b2-acbd-d835f9e44f70 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:01.381201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d90521-2164-42b2-acbd-d835f9e44f70 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:01.383312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d90521-2164-42b2-acbd-d835f9e44f70 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:01.413998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 400/799] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 25 14:43:01 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:03.688753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4dec-dfc0-423b-8a72-abba2bde1fcd None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:03.689282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4dec-dfc0-423b-8a72-abba2bde1fcd None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:03.689282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4dec-dfc0-423b-8a72-abba2bde1fcd None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:03.691002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 400/800] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:03.696108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e73e5-a6fa-4246-9402-8ff59adcb158 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:03.696527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e73e5-a6fa-4246-9402-8ff59adcb158 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:03.696673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e73e5-a6fa-4246-9402-8ff59adcb158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:03.719058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-d22e73e5-a6fa-4246-9402-8ff59adcb158 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:03.720524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d22e73e5-a6fa-4246-9402-8ff59adcb158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:03.727533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 401/801] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:03 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:03.751989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4dec-dfc0-423b-8a72-abba2bde1fcd None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:03.764180 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4dec-dfc0-423b-8a72-abba2bde1fcd None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:03.768130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:03.768832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:03.769113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:03.769384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:03.782787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:03.784606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:03.801435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:03.802816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 401/802] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:03.809583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e73e5-a6fa-4246-9402-8ff59adcb158 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:03.819245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e73e5-a6fa-4246-9402-8ff59adcb158 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:03.824064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f142b-eb43-4c89-9b9b-e26dc3b84c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:03.824649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f142b-eb43-4c89-9b9b-e26dc3b84c8e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:03.824939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f142b-eb43-4c89-9b9b-e26dc3b84c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:03.825213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f142b-eb43-4c89-9b9b-e26dc3b84c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:03.825890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f142b-eb43-4c89-9b9b-e26dc3b84c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:03.826184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f142b-eb43-4c89-9b9b-e26dc3b84c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:03.827889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f142b-eb43-4c89-9b9b-e26dc3b84c8e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:03.840014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 402/803] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:03.845691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:03.855000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef7309-7bd4-4c69-83e6-ad1a48983927 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:03.859323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281a27c-973c-4844-833c-382cdf302a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:03.859901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281a27c-973c-4844-833c-382cdf302a98 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:03.860183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281a27c-973c-4844-833c-382cdf302a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:03.860454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281a27c-973c-4844-833c-382cdf302a98 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:03.861103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281a27c-973c-4844-833c-382cdf302a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:03.863017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281a27c-973c-4844-833c-382cdf302a98 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:03.883222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 402/804] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:43:03 2021] POST /identity/v3/users => generated 249 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:43:05.998604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c8a4-e1e4-4b4f-b7ed-72c4f80a6df9 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:05.999195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c8a4-e1e4-4b4f-b7ed-72c4f80a6df9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:05.999195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c8a4-e1e4-4b4f-b7ed-72c4f80a6df9 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.000827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 403/805] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:06.006074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1956-1674-493c-bcbf-54e177727907 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.006507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1956-1674-493c-bcbf-54e177727907 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.006677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1956-1674-493c-bcbf-54e177727907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.028765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-536c1956-1674-493c-bcbf-54e177727907 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:06.029919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-536c1956-1674-493c-bcbf-54e177727907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:06.036963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 403/806] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:06 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:06.060424 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c8a4-e1e4-4b4f-b7ed-72c4f80a6df9 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.072023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c8a4-e1e4-4b4f-b7ed-72c4f80a6df9 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.076579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4857c-9a08-4539-b5fd-e4aa79f52506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.077232 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4857c-9a08-4539-b5fd-e4aa79f52506 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.077517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4857c-9a08-4539-b5fd-e4aa79f52506 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.077793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4857c-9a08-4539-b5fd-e4aa79f52506 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.089083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4857c-9a08-4539-b5fd-e4aa79f52506 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:06.095581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-88b4857c-9a08-4539-b5fd-e4aa79f52506 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:43:06.096661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 404/807] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:06.102578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c1956-1674-493c-bcbf-54e177727907 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.112085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c1956-1674-493c-bcbf-54e177727907 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.116335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.116927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.117217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.117502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.118219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:06.118553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.120158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.128406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 404/808] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:06.134010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4857c-9a08-4539-b5fd-e4aa79f52506 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.144210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4857c-9a08-4539-b5fd-e4aa79f52506 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.148375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.149077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.149362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.149638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.161222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.163120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.181003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:06.182084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 405/809] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:06.187846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.197188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe649d4-eea0-4fc6-840d-eb1b548496fa admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.201891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703692-60b7-4257-802b-d798427c125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.202509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703692-60b7-4257-802b-d798427c125d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.202802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703692-60b7-4257-802b-d798427c125d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.203085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703692-60b7-4257-802b-d798427c125d admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.203781 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703692-60b7-4257-802b-d798427c125d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:06.204081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703692-60b7-4257-802b-d798427c125d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.205655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703692-60b7-4257-802b-d798427c125d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.218418 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 405/810] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:06.223976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.233397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e820-c15e-4cb7-bf45-c8bad167969d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.237505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.238215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.238536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.238814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.251127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.253123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.271028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 14:43:06.272233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 406/811] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:06.279155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703692-60b7-4257-802b-d798427c125d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.289118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703692-60b7-4257-802b-d798427c125d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.293671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.294290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.294621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.294905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.295713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:06.296019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.297885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.327936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 406/812] 10.222.0.57 () {56 vars in 1160 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:06.333752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.343798 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b3dfd-33bc-4ea8-89b6-b85780a64b4f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.347978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fa31c-d513-41fb-9b62-a201c5df7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.348554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa31c-d513-41fb-9b62-a201c5df7d64 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.348841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa31c-d513-41fb-9b62-a201c5df7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.349120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa31c-d513-41fb-9b62-a201c5df7d64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.356905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fa31c-d513-41fb-9b62-a201c5df7d64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.358946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fa31c-d513-41fb-9b62-a201c5df7d64 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.367852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 407/813] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:43:06.373786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.383235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baeb29-37bf-49f5-bb12-0d6531bf82b1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.388199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.389004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.389298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.389586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.401725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.403561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.420254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:06.421380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 407/814] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:06.427246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fa31c-d513-41fb-9b62-a201c5df7d64 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.436900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fa31c-d513-41fb-9b62-a201c5df7d64 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.441185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.441769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.442051 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.442330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.443037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:06.443343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.444923 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.457610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 408/815] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:06.464068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.473455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca34c-1660-4452-b954-6698370e3fb2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.477609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.478322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.478647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.478929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.487535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.489580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.503617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:06.504741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 408/816] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:43:06.511303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.520687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda97f4-5c0a-4902-b7fd-ac67434a02b9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.524851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a3f50-2454-4436-abef-5a08381d2a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.525430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3f50-2454-4436-abef-5a08381d2a8e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.525753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3f50-2454-4436-abef-5a08381d2a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.526037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3f50-2454-4436-abef-5a08381d2a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.526814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3f50-2454-4436-abef-5a08381d2a8e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:06.527117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3f50-2454-4436-abef-5a08381d2a8e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.528940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3f50-2454-4436-abef-5a08381d2a8e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.543467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 409/817] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:06.549553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:06.559517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2457b-e822-4c03-b92f-db45d25b5731 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:06.563687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eff911-380d-4d5b-b361-6a6221bd5041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:06.564259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff911-380d-4d5b-b361-6a6221bd5041 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:06.564552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff911-380d-4d5b-b361-6a6221bd5041 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:06.564837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff911-380d-4d5b-b361-6a6221bd5041 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:06.565618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eff911-380d-4d5b-b361-6a6221bd5041 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=b7a70a0361b648d6a4233546a1d4901d) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:06.565924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eff911-380d-4d5b-b361-6a6221bd5041 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:06.567785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eff911-380d-4d5b-b361-6a6221bd5041 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:06.573691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 409/818] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:43:06 2021] GET /identity/v3/role_assignments?user.id=b7a70a0361b648d6a4233546a1d4901d&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:08.646231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d943606-faf5-4939-99a3-aaf33e2dedba None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:08.646813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d943606-faf5-4939-99a3-aaf33e2dedba None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:08.646813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d943606-faf5-4939-99a3-aaf33e2dedba None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:08.648481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 410/819] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:08.653610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299277-f574-4854-9eab-1afbbad7236a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:08.654041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299277-f574-4854-9eab-1afbbad7236a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:08.654177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299277-f574-4854-9eab-1afbbad7236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:08.676992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-19299277-f574-4854-9eab-1afbbad7236a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:08.678143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-19299277-f574-4854-9eab-1afbbad7236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:08.685717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 410/820] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:08 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:08.707497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d943606-faf5-4939-99a3-aaf33e2dedba None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:08.719077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d943606-faf5-4939-99a3-aaf33e2dedba None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:08.723043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4fe37-c46d-4987-812b-c9ac3054ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:08.723753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4fe37-c46d-4987-812b-c9ac3054ba1e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:08.724034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4fe37-c46d-4987-812b-c9ac3054ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:08.724306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4fe37-c46d-4987-812b-c9ac3054ba1e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:08.735775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4fe37-c46d-4987-812b-c9ac3054ba1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:08.742305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-7cf4fe37-c46d-4987-812b-c9ac3054ba1e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:43:08.743390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 411/821] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:08.749920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299277-f574-4854-9eab-1afbbad7236a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:08.758613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299277-f574-4854-9eab-1afbbad7236a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:08.762863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:08.763453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:08.763742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:08.764025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:08.764737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:08.765035 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:08.766653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:08.774849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 411/822] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:43:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:08.780904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4fe37-c46d-4987-812b-c9ac3054ba1e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:08.791314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4fe37-c46d-4987-812b-c9ac3054ba1e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:08.795967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:08.797420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:08.797705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:08.797983 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:08.809007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:08.810867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:08.827629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:08.828726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 412/823] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:08.834600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:08.844378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fcc8e-a79d-4114-a352-f5bfa0d75ebf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:08.848551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:08.849126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:08.849414 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:08.849695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:08.850381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:08.850775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:08.852349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:08.865379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 412/824] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:08.871068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:08.880278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b737-df12-4631-a623-8a70f28da892 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:08.884435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:08.885149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:08.885432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:08.885709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:08.898091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:08.900056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:08.920504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 14:43:08.921708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 413/825] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:08 2021] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:08.927900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:08.937908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc79c30-af93-43f6-b231-034955583640 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:08.942228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:08.942870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:08.943159 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:08.943440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:08.944239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:08.944543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:08.946558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:08.975767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 413/826] 10.222.0.57 () {56 vars in 1160 bytes} [Mon Oct 25 14:43:08 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:08.982103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:08.995570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c099e-5a84-4a25-9f35-1895a65771f6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:08.999765 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:09.000482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:09.000773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:09.001055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:09.012945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:09.014811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:09.032192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:09.033305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 414/827] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:09.039104 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:09.049083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d5a7-b33b-49cf-ae2c-21b334473570 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:09.053318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:09.053904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:09.054193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:09.054519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:09.055213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:09.055514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:09.057115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:09.069489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 414/828] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:09.075236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:09.084742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8681ac-ebb9-41eb-b4ca-efa406ab0c2a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:09.089792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:09.090543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:09.090836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:09.091121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:09.099797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:09.101759 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:09.116263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:09.117371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 415/829] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:09.123441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:09.132820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80fd02-9bd2-487b-8b33-cf7619a74c9b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:09.137637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee20b52-77cd-4d9d-9d40-4906b377058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:09.138225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20b52-77cd-4d9d-9d40-4906b377058c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:09.138543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20b52-77cd-4d9d-9d40-4906b377058c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:09.138826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20b52-77cd-4d9d-9d40-4906b377058c admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:09.139576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee20b52-77cd-4d9d-9d40-4906b377058c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:09.139879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee20b52-77cd-4d9d-9d40-4906b377058c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:09.141701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee20b52-77cd-4d9d-9d40-4906b377058c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:09.156656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 415/830] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:09.162602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:09.172049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71707d9-44e5-4277-aaf4-38d59a7632b8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:09.176306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7896df-7424-43cf-b525-7ece5cc23b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:09.177125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7896df-7424-43cf-b525-7ece5cc23b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:09.177415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7896df-7424-43cf-b525-7ece5cc23b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:09.177696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7896df-7424-43cf-b525-7ece5cc23b98 admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/b7a70a0361b648d6a4233546a1d4901d/roles/7aaa6f36ae64405697ffb965e125aae6` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:09.198210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7896df-7424-43cf-b525-7ece5cc23b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=b7a70a0361b648d6a4233546a1d4901d, role_id=7aaa6f36ae64405697ffb965e125aae6)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:09.200859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7896df-7424-43cf-b525-7ece5cc23b98 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:09.213971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 416/831] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:43:09 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/b7a70a0361b648d6a4233546a1d4901d/roles/7aaa6f36ae64405697ffb965e125aae6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:43:11.270587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8e3a-38ab-4cb2-bd8a-ce4ec62f8e46 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.271089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8e3a-38ab-4cb2-bd8a-ce4ec62f8e46 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.271089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8e3a-38ab-4cb2-bd8a-ce4ec62f8e46 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.272736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 416/832] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:11.278325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa1d0-3264-42a7-a582-478f3e919b4f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.278726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa1d0-3264-42a7-a582-478f3e919b4f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.278916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa1d0-3264-42a7-a582-478f3e919b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.301192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-aaeaa1d0-3264-42a7-a582-478f3e919b4f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:11.302336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-aaeaa1d0-3264-42a7-a582-478f3e919b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:11.366507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 417/833] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:11 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:11.390206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be8e3a-38ab-4cb2-bd8a-ce4ec62f8e46 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.402496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be8e3a-38ab-4cb2-bd8a-ce4ec62f8e46 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.406462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c843a5-7a99-45d7-9ac5-597ddff4a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.407169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c843a5-7a99-45d7-9ac5-597ddff4a6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.407455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c843a5-7a99-45d7-9ac5-597ddff4a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.407729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c843a5-7a99-45d7-9ac5-597ddff4a6b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.418472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c843a5-7a99-45d7-9ac5-597ddff4a6b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:11.424825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-68c843a5-7a99-45d7-9ac5-597ddff4a6b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:43:11.425922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 417/834] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:11.432029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa1d0-3264-42a7-a582-478f3e919b4f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.440683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa1d0-3264-42a7-a582-478f3e919b4f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.444917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.445511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.445799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.446081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.446824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:11.447127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.449264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.457507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 418/835] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:11.463771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c843a5-7a99-45d7-9ac5-597ddff4a6b7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.473386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c843a5-7a99-45d7-9ac5-597ddff4a6b7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.477453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.478146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.478454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.478734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.489823 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.491671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.508275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:11.509339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 418/836] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:43:11.515559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.524890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad1b0-1b0d-42e4-9506-8e6e059d84fc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.529667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.530249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.530590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.530880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.531569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:11.531867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.533455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.545697 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 419/837] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:11.551304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.561244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3166fb6-d96c-4a57-9c5b-d4392fba57b9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.565609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.566351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.566667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.566939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.581093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.583162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.602424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 14:43:11.603782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 419/838] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:11.610027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.619580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5c8d7-0ec9-4dc1-bc92-501b9c70b77f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.623756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.624351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.624644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.624924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.625704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:11.626005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.627874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.658894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 420/839] 10.222.0.57 () {56 vars in 1160 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:11.664667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.674069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641659-63eb-4a9e-aa0e-7dfab0f7b061 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.678204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605a2f-12ab-41be-a24d-89ee99687edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.678811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605a2f-12ab-41be-a24d-89ee99687edd admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.679094 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605a2f-12ab-41be-a24d-89ee99687edd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.679368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605a2f-12ab-41be-a24d-89ee99687edd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.686962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605a2f-12ab-41be-a24d-89ee99687edd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.688687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605a2f-12ab-41be-a24d-89ee99687edd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.698218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 420/840] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:43:11.703993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.713879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c9d7-de5b-493c-ad64-e44bbd2fd9d4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.718262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.719035 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.719325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.719608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.731817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.733902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.751260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:11.752365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 421/841] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:11.758173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605a2f-12ab-41be-a24d-89ee99687edd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.767439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605a2f-12ab-41be-a24d-89ee99687edd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.771708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.772288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.772569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.772847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.773537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:11.773831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.775483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.787900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 421/842] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:11.793483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.803096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85b03a-5c5a-4071-aab9-91d99e855bf3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.807784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.808504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.808790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.809066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.817569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.819540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.834446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:11.835552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 422/843] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:11.841720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.851276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93ef7-febc-407d-8f70-309bee67a3c5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.855449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2caae-9811-47fb-91a3-34bb5a0a1211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.856032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2caae-9811-47fb-91a3-34bb5a0a1211 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.856323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2caae-9811-47fb-91a3-34bb5a0a1211 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.856605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2caae-9811-47fb-91a3-34bb5a0a1211 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.857353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2caae-9811-47fb-91a3-34bb5a0a1211 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:11.857655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2caae-9811-47fb-91a3-34bb5a0a1211 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.859763 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2caae-9811-47fb-91a3-34bb5a0a1211 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.873485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 422/844] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:11.879742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:11.889877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930044f3-71ce-44ac-8a8e-40f409ef2978 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:11.894100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a420c2f-240d-4297-bafd-bb2fdb49830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:11.894711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420c2f-240d-4297-bafd-bb2fdb49830b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:11.894999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420c2f-240d-4297-bafd-bb2fdb49830b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:11.895279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420c2f-240d-4297-bafd-bb2fdb49830b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:11.896065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a420c2f-240d-4297-bafd-bb2fdb49830b admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=b7a70a0361b648d6a4233546a1d4901d) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:11.896368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a420c2f-240d-4297-bafd-bb2fdb49830b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:11.898202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a420c2f-240d-4297-bafd-bb2fdb49830b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:11.903985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 423/845] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:43:11 2021] GET /identity/v3/role_assignments?user.id=b7a70a0361b648d6a4233546a1d4901d&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:14.001491 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0aa18-fa2b-4959-b3ba-9ddffb0701d3 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:14.002049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0aa18-fa2b-4959-b3ba-9ddffb0701d3 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:14.002049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0aa18-fa2b-4959-b3ba-9ddffb0701d3 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:14.003758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 423/846] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:14.008940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bca31-61fe-4b2a-b4cf-0ee3ad4b7d1f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:14.009351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bca31-61fe-4b2a-b4cf-0ee3ad4b7d1f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:14.009502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bca31-61fe-4b2a-b4cf-0ee3ad4b7d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:14.031552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1c0bca31-61fe-4b2a-b4cf-0ee3ad4b7d1f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:14.032675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1c0bca31-61fe-4b2a-b4cf-0ee3ad4b7d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:14.039530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 424/847] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:14 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:14.061559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0aa18-fa2b-4959-b3ba-9ddffb0701d3 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:14.073515 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0aa18-fa2b-4959-b3ba-9ddffb0701d3 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:14.077443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:14.078148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:14.078454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:14.078736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:14.079356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:14.080899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:14.091544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 14:43:14.092589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 424/848] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:14 2021] GET /identity/v3/services/network => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:14.098618 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bca31-61fe-4b2a-b4cf-0ee3ad4b7d1f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:14.107786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bca31-61fe-4b2a-b4cf-0ee3ad4b7d1f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:14.112314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63010ced-9800-4e18-8ccb-0715e86df975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:14.112901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010ced-9800-4e18-8ccb-0715e86df975 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:14.113187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010ced-9800-4e18-8ccb-0715e86df975 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:14.113463 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010ced-9800-4e18-8ccb-0715e86df975 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:14.114123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63010ced-9800-4e18-8ccb-0715e86df975 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:14.114443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63010ced-9800-4e18-8ccb-0715e86df975 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:14.116006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63010ced-9800-4e18-8ccb-0715e86df975 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:14.120640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 425/849] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:43:14 2021] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:14.126064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:14.135361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918c08f-2462-4c51-bace-d8ad0c9c47a1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:14.139582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91d61-8d38-4e07-91c6-746cf6b79b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:14.140162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91d61-8d38-4e07-91c6-746cf6b79b25 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:14.140451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91d61-8d38-4e07-91c6-746cf6b79b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:14.140736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91d61-8d38-4e07-91c6-746cf6b79b25 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:14.141412 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db91d61-8d38-4e07-91c6-746cf6b79b25 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:14.141711 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db91d61-8d38-4e07-91c6-746cf6b79b25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:14.143307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db91d61-8d38-4e07-91c6-746cf6b79b25 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:14.147814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 425/850] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:43:14 2021] GET /identity/v3/services?type=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:16.207960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e926-4237-4cf2-a920-a057bb99d648 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:16.208469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e926-4237-4cf2-a920-a057bb99d648 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:16.208469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e926-4237-4cf2-a920-a057bb99d648 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:16.210107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 426/851] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:16.215928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87a15b-b030-4e8f-98ec-1b56c7f9ef54 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:16.216335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87a15b-b030-4e8f-98ec-1b56c7f9ef54 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:16.216486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87a15b-b030-4e8f-98ec-1b56c7f9ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:16.238093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-be87a15b-b030-4e8f-98ec-1b56c7f9ef54 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:16.239242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-be87a15b-b030-4e8f-98ec-1b56c7f9ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:16.246620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 426/852] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:16 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:16.269531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e926-4237-4cf2-a920-a057bb99d648 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:16.281418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e926-4237-4cf2-a920-a057bb99d648 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:16.285433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11ff52-f00f-470a-9304-3625ba5c0f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:16.286012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11ff52-f00f-470a-9304-3625ba5c0f36 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:16.286298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11ff52-f00f-470a-9304-3625ba5c0f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:16.286610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11ff52-f00f-470a-9304-3625ba5c0f36 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:16.287285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11ff52-f00f-470a-9304-3625ba5c0f36 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:16.288855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11ff52-f00f-470a-9304-3625ba5c0f36 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:16.302149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 427/853] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:43:16 2021] POST /identity/v3/services => generated 240 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:43:18.402914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7fb06-4501-4902-accd-89a32cd31331 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:18.403439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7fb06-4501-4902-accd-89a32cd31331 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:18.403523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7fb06-4501-4902-accd-89a32cd31331 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:18.405149 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 427/854] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:18.410304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a48657-70ea-4783-be53-17e70c9757d6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:18.410698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a48657-70ea-4783-be53-17e70c9757d6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:18.410905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a48657-70ea-4783-be53-17e70c9757d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:18.438059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-38a48657-70ea-4783-be53-17e70c9757d6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:18.439231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-38a48657-70ea-4783-be53-17e70c9757d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:18.456171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 428/855] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:18 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:18.478021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7fb06-4501-4902-accd-89a32cd31331 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:18.490459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7fb06-4501-4902-accd-89a32cd31331 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:18.495085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:18.495805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:18.496092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:18.496373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] PATH_INFO: `/v3/services/network` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:18.497000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:18.498608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:18.508861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 14:43:18.509941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 428/856] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:18 2021] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:18.515908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a48657-70ea-4783-be53-17e70c9757d6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:18.524567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a48657-70ea-4783-be53-17e70c9757d6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:18.529338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:18.529928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:18.530217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:18.530540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:18.531214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:18.531517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:18.533093 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:18.537766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 429/857] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:43:18 2021] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:18.544023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:18.553305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735bc0-d2f5-4068-a412-1b647b69ccbf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:18.557478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:18.558053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:18.558340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:18.558649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:18.559323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] RBAC: Adding query filter params (type=network) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:18.559623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:18.561179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:18.565743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 429/858] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:43:18 2021] GET /identity/v3/services?type=network => generated 350 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:18.571368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:18.580617 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732453a6-3b83-4817-a69f-e0427cc86d62 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:18.584850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecaf67-ddd4-45b9-98cf-0d51d8a8c483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:18.585427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecaf67-ddd4-45b9-98cf-0d51d8a8c483 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:18.585713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecaf67-ddd4-45b9-98cf-0d51d8a8c483 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:18.585993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecaf67-ddd4-45b9-98cf-0d51d8a8c483 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:18.586771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecaf67-ddd4-45b9-98cf-0d51d8a8c483 admin admin] RBAC: Adding query filter params (interface=public, service_id=edc2cc89d9ec4fa69e017aca2e673ccc, region_id=RegionOne) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:18.587075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecaf67-ddd4-45b9-98cf-0d51d8a8c483 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:18.589171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecaf67-ddd4-45b9-98cf-0d51d8a8c483 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:18.594220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 430/859] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:43:18 2021] GET /identity/v3/endpoints?service_id=edc2cc89d9ec4fa69e017aca2e673ccc&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:18.599691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:18.609758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f23272-525d-457c-aa79-3cd7d005671c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:18.613915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6548629-7ada-47cb-a0a6-02fe131deb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:18.614523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6548629-7ada-47cb-a0a6-02fe131deb85 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:18.614813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6548629-7ada-47cb-a0a6-02fe131deb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:18.615096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6548629-7ada-47cb-a0a6-02fe131deb85 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:18.615743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6548629-7ada-47cb-a0a6-02fe131deb85 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:18.617315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6548629-7ada-47cb-a0a6-02fe131deb85 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:18.623673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 430/860] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:43:18 2021] GET /identity/v3/services => generated 1967 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:43:20.726094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb05fb-2bc0-4d82-b6a9-d70aa45a7146 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:20.726666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb05fb-2bc0-4d82-b6a9-d70aa45a7146 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:20.726752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb05fb-2bc0-4d82-b6a9-d70aa45a7146 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:20.728867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 431/861] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:20.734396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb43f-f346-4471-867e-fdaad90772c0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:20.734846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb43f-f346-4471-867e-fdaad90772c0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:20.734988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb43f-f346-4471-867e-fdaad90772c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:20.757113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6e3cb43f-f346-4471-867e-fdaad90772c0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:20.758251 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6e3cb43f-f346-4471-867e-fdaad90772c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:20.765201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 431/862] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:20 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:43:20.787776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb05fb-2bc0-4d82-b6a9-d70aa45a7146 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:20.800144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb05fb-2bc0-4d82-b6a9-d70aa45a7146 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:20.804329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:20.805045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:20.805331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:20.805611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] PATH_INFO: `/v3/services/network` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:20.806229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:20.807853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:20.818278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 14:43:20.819413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 432/863] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:20 2021] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:20.825449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb43f-f346-4471-867e-fdaad90772c0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:20.834144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb43f-f346-4471-867e-fdaad90772c0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:20.838879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:20.839461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:20.839748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:20.840030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:20.840706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] RBAC: Adding query filter params (name=network) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:20.841008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:20.842608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:20.847294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 432/864] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:43:20 2021] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:20.852804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:20.863134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe4e45-e908-4f8a-9539-af75662a60ae admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:20.867274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ef77c-a0af-48f3-82ca-4e8ebe4e2d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:20.867855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ef77c-a0af-48f3-82ca-4e8ebe4e2d98 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:20.868137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ef77c-a0af-48f3-82ca-4e8ebe4e2d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:20.868410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ef77c-a0af-48f3-82ca-4e8ebe4e2d98 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:20.869070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ef77c-a0af-48f3-82ca-4e8ebe4e2d98 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:20.869367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ef77c-a0af-48f3-82ca-4e8ebe4e2d98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:20.870961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ef77c-a0af-48f3-82ca-4e8ebe4e2d98 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:20.875504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 433/865] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 25 14:43:20 2021] GET /identity/v3/services?type=network => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:20.881331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:20.890831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ea722-f7e1-4278-bae4-89f8ae08cb9f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:20.894991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6f48-3ae0-4d21-9a50-50b545ef1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:20.895561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6f48-3ae0-4d21-9a50-50b545ef1f09 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:20.895849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6f48-3ae0-4d21-9a50-50b545ef1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:20.896130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6f48-3ae0-4d21-9a50-50b545ef1f09 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:20.896821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6f48-3ae0-4d21-9a50-50b545ef1f09 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:20.898382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6f48-3ae0-4d21-9a50-50b545ef1f09 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:20.917263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 433/866] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:43:20 2021] POST /identity/v3/endpoints => generated 327 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:43:23.180153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56514a7-f9d0-4a3b-b4b1-f029787b1b9b None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:23.180675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56514a7-f9d0-4a3b-b4b1-f029787b1b9b None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:23.180675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56514a7-f9d0-4a3b-b4b1-f029787b1b9b None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:23.182489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 434/867] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:23.188244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd5b5-56e9-4026-8638-66f9d3ab8845 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:23.188773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd5b5-56e9-4026-8638-66f9d3ab8845 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:23.188773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd5b5-56e9-4026-8638-66f9d3ab8845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:23.214839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-dbffd5b5-56e9-4026-8638-66f9d3ab8845 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:23.216436 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-dbffd5b5-56e9-4026-8638-66f9d3ab8845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:23.237551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 434/868] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:23.264364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56514a7-f9d0-4a3b-b4b1-f029787b1b9b None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:23.276989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56514a7-f9d0-4a3b-b4b1-f029787b1b9b None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:23.281049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:23.281636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:23.281923 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:23.282207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:23.283004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:23.284581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:23.290527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.sql.core [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 25 14:43:23.290527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 25 14:43:23.290527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [parameters: {'id': '6d70fd52b78a4cf3a760f383281647af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 25 14:43:23.290527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66562) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 25 14:43:23.296600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 25 14:43:23.297717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 435/869] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:43:23 2021] POST /identity/v3/roles => generated 144 bytes in 34 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:23.303819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffd5b5-56e9-4026-8638-66f9d3ab8845 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:23.312470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffd5b5-56e9-4026-8638-66f9d3ab8845 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:23.316785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bd0b4-1467-4089-bc54-26eb0bed260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:23.317518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bd0b4-1467-4089-bc54-26eb0bed260a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:23.317805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bd0b4-1467-4089-bc54-26eb0bed260a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:23.318088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bd0b4-1467-4089-bc54-26eb0bed260a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:23.329429 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bd0b4-1467-4089-bc54-26eb0bed260a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:23.336343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-369bd0b4-1467-4089-bc54-26eb0bed260a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 14:43:23.337993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 435/870] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 25 14:43:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:43:23.344047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:23.354362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15e96-e255-4dfe-97d3-cc75a744a5bb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:23.359002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f7ef3-f66b-492c-a3cd-0f1b32f4d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:23.359596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f7ef3-f66b-492c-a3cd-0f1b32f4d41c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:23.359888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f7ef3-f66b-492c-a3cd-0f1b32f4d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:23.360172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f7ef3-f66b-492c-a3cd-0f1b32f4d41c admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:23.360888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f7ef3-f66b-492c-a3cd-0f1b32f4d41c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:23.361188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f7ef3-f66b-492c-a3cd-0f1b32f4d41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:23.362819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f7ef3-f66b-492c-a3cd-0f1b32f4d41c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:23.371513 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 436/871] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:25.478657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ad22-a453-4ec5-a0ea-526d544da6e1 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:25.479185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ad22-a453-4ec5-a0ea-526d544da6e1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:25.479185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ad22-a453-4ec5-a0ea-526d544da6e1 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:25.480887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 436/872] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:25.486835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd34b-3554-472e-acc4-306e2ae47e37 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:25.487237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd34b-3554-472e-acc4-306e2ae47e37 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:25.487400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd34b-3554-472e-acc4-306e2ae47e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:25.508904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c95fd34b-3554-472e-acc4-306e2ae47e37 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:25.510046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c95fd34b-3554-472e-acc4-306e2ae47e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:25.517031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 437/873] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:25.541893 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1ad22-a453-4ec5-a0ea-526d544da6e1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:25.554247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1ad22-a453-4ec5-a0ea-526d544da6e1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:25.558358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:25.559098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:25.559382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:25.559662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:25.570610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:25.572412 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:25.589643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:25.590765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 437/874] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:43:25.596762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd34b-3554-472e-acc4-306e2ae47e37 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:25.606060 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd34b-3554-472e-acc4-306e2ae47e37 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:25.610608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f110228-04a8-407e-8216-0009459826aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:25.611197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110228-04a8-407e-8216-0009459826aa admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:25.611488 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110228-04a8-407e-8216-0009459826aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:25.611771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110228-04a8-407e-8216-0009459826aa admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:25.612458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110228-04a8-407e-8216-0009459826aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:25.612758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110228-04a8-407e-8216-0009459826aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:25.614332 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110228-04a8-407e-8216-0009459826aa admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:25.626482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 438/875] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:25.632129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:25.641994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f2296-4213-4402-b5ee-7245116c1cab admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:25.646228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63770d-3b6a-43e5-92ee-7f342c367f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:25.646854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63770d-3b6a-43e5-92ee-7f342c367f85 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:25.647142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63770d-3b6a-43e5-92ee-7f342c367f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:25.647425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63770d-3b6a-43e5-92ee-7f342c367f85 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:25.648083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63770d-3b6a-43e5-92ee-7f342c367f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:25.650567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63770d-3b6a-43e5-92ee-7f342c367f85 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:25.669620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 438/876] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:43:25 2021] POST /identity/v3/users => generated 247 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:43:27.759518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189df2-646c-4db2-934e-b40c390f7073 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:27.760081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189df2-646c-4db2-934e-b40c390f7073 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:27.760081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189df2-646c-4db2-934e-b40c390f7073 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:27.761749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 439/877] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:27.767023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2036-cb29-44eb-bef6-6c074050923c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:27.767425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2036-cb29-44eb-bef6-6c074050923c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:27.767679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2036-cb29-44eb-bef6-6c074050923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:27.789771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ed7d2036-cb29-44eb-bef6-6c074050923c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:27.791512 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ed7d2036-cb29-44eb-bef6-6c074050923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:27.799554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 439/878] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:27.822531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189df2-646c-4db2-934e-b40c390f7073 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:27.834318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189df2-646c-4db2-934e-b40c390f7073 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:27.838898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc217e-188d-4f36-ac22-f9aa0ae28bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:27.839618 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc217e-188d-4f36-ac22-f9aa0ae28bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:27.839900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc217e-188d-4f36-ac22-f9aa0ae28bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:27.840181 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc217e-188d-4f36-ac22-f9aa0ae28bf5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:27.851179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc217e-188d-4f36-ac22-f9aa0ae28bf5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:27.858701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-94cc217e-188d-4f36-ac22-f9aa0ae28bf5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:43:27.859798 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 440/879] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:27.865861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d2036-cb29-44eb-bef6-6c074050923c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:27.874527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d2036-cb29-44eb-bef6-6c074050923c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:27.878710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:27.879298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:27.879582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:27.879865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:27.880576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:27.880873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:27.882467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:27.891116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 440/880] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:43:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:27.896761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc217e-188d-4f36-ac22-f9aa0ae28bf5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:27.907507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc217e-188d-4f36-ac22-f9aa0ae28bf5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:27.911709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:27.912423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:27.912715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:27.912997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:27.924082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:27.925896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:27.942982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:27.944086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 441/881] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:43:27.950447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:27.959847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44927f-1df9-40d5-931c-6e2a2cd6b875 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:27.964831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:27.965437 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:27.965726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:27.966008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:27.966756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:27.967057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:27.968684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:27.983692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 441/882] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:27.989706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:27.999710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007d460-0993-44a6-9708-f7eb76823b2a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:28.004012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:28.004742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:28.005031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:28.005311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:28.019024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:28.020966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:28.039409 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 14:43:28.040555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 442/883] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:27 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:28.046485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:28.055840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24e32-a186-4a49-ad83-72e2ccddf7ca admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:28.060115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:28.060708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:28.060992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:28.061267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:28.062051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:28.062347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:28.064176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:28.092902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 442/884] 10.222.0.57 () {56 vars in 1156 bytes} [Mon Oct 25 14:43:28 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:28.098772 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:28.108404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c5441-6b1b-4d3f-bd08-dd254011ffa7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:28.112561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53b9ee-6981-4bdd-851d-099566f531e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:28.113134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53b9ee-6981-4bdd-851d-099566f531e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:28.113423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53b9ee-6981-4bdd-851d-099566f531e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:28.113699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53b9ee-6981-4bdd-851d-099566f531e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:28.121629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53b9ee-6981-4bdd-851d-099566f531e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:28.123446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53b9ee-6981-4bdd-851d-099566f531e0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:28.132482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 443/885] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:43:28 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:43:28.138916 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:28.148457 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee43d-f9a0-4b8a-83f9-492c92f98eda admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:28.153249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:28.153967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:28.154254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:28.154579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:28.166110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:28.167962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:28.184471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:28.185572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 443/886] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:28.195237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53b9ee-6981-4bdd-851d-099566f531e0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:28.207769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53b9ee-6981-4bdd-851d-099566f531e0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:28.212055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:28.213217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:28.213500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:28.213775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:28.214476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:28.214770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:28.216358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:28.228410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 444/887] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:28.234490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:28.244306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b75a1-51c9-4484-8cd1-9c56a8c7bbe4 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:28.248633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:28.249343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:28.249625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:28.249898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:28.258659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:28.261218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:28.274582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:28.275642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 444/888] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:28.281757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:28.291264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06369c3-a790-4716-b19a-9fb3ab7e6cfe admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:28.295480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230da6b1-2897-44de-a7ee-8e0729f41ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:28.296074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230da6b1-2897-44de-a7ee-8e0729f41ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:28.296363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230da6b1-2897-44de-a7ee-8e0729f41ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:28.296642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230da6b1-2897-44de-a7ee-8e0729f41ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:28.297397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230da6b1-2897-44de-a7ee-8e0729f41ed5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:28.297700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230da6b1-2897-44de-a7ee-8e0729f41ed5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:28.299561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230da6b1-2897-44de-a7ee-8e0729f41ed5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:28.314296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 445/889] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:28.320552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:28.330532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b4b20-f228-4443-8beb-10169cac05ee admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:28.334728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7d09c-b0c9-4f40-8d93-d286218227e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:28.335308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d09c-b0c9-4f40-8d93-d286218227e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:28.335596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d09c-b0c9-4f40-8d93-d286218227e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:28.335878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d09c-b0c9-4f40-8d93-d286218227e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:28.336661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d09c-b0c9-4f40-8d93-d286218227e9 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=514d94b70d2d4b14b99a9b235942723e) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:28.336967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d09c-b0c9-4f40-8d93-d286218227e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:28.338831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d09c-b0c9-4f40-8d93-d286218227e9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:28.344166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 445/890] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:43:28 2021] GET /identity/v3/role_assignments?user.id=514d94b70d2d4b14b99a9b235942723e&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:30.382827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295373-d9e8-430d-87ba-ffbf97f4a472 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.383363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295373-d9e8-430d-87ba-ffbf97f4a472 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.383452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295373-d9e8-430d-87ba-ffbf97f4a472 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.385100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 446/891] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:30.390272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfddc3-92b0-42b1-9119-0256e1884ede None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.390703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfddc3-92b0-42b1-9119-0256e1884ede None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.390859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfddc3-92b0-42b1-9119-0256e1884ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.412506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-56cfddc3-92b0-42b1-9119-0256e1884ede None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:30.413707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-56cfddc3-92b0-42b1-9119-0256e1884ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:30.421233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 446/892] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:30.444030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0295373-d9e8-430d-87ba-ffbf97f4a472 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.455678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0295373-d9e8-430d-87ba-ffbf97f4a472 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.459701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fc8ff-a508-4c67-a88b-bd3f7cfc8cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.460407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fc8ff-a508-4c67-a88b-bd3f7cfc8cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.460692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fc8ff-a508-4c67-a88b-bd3f7cfc8cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.460968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fc8ff-a508-4c67-a88b-bd3f7cfc8cc9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.471862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fc8ff-a508-4c67-a88b-bd3f7cfc8cc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:30.478915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-ed8fc8ff-a508-4c67-a88b-bd3f7cfc8cc9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:43:30.480001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 447/893] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:30.486312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfddc3-92b0-42b1-9119-0256e1884ede None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.495539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfddc3-92b0-42b1-9119-0256e1884ede None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.499733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.500313 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.500601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.500880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.501589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:30.501884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.503476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.511633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 447/894] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:30.517232 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fc8ff-a508-4c67-a88b-bd3f7cfc8cc9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.527451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fc8ff-a508-4c67-a88b-bd3f7cfc8cc9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.531605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.532304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.532592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.532871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.544475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.546308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.563420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:30.564511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 448/895] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:30.570322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.579612 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679053-a823-407d-bb04-e500e126261b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.583739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.584309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.584592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.584866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.585550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:30.585844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.587935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.599955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 448/896] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:30.606114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.616125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baf813-c96f-4456-9cee-21d004b2f9e5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.620551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.621305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.621601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.621881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.635784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.637734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.657057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 14:43:30.658213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 449/897] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:30.664946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.675004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349a766-a8c9-46df-a982-e8c24466676c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.679329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.679919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.680206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.680485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.681298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:30.681602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.683463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.711543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 449/898] 10.222.0.57 () {56 vars in 1156 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:30.717928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.727368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ec0c3-e907-4844-8ec8-184ef057b827 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.732122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.732834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.733387 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.733665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.745333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.747171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.764158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:30.765284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 450/899] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:30.771174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.781188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a11cc-e456-4c2d-9b9f-9800ef32c74d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.786052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.786667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.786959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.787243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.787939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:30.788236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.789826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.803617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 450/900] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:30.809442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.819209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bb15d-e413-46ad-b8b8-1b5a73d489b6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.823462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.824178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.824462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.824734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.833238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.835199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.849023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:30.850135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 451/901] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:30.856893 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.866736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec32f9-d741-4e40-b8d6-ac50482cad07 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.870971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e18bf-2945-4481-ba9f-d40503dd9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.871549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e18bf-2945-4481-ba9f-d40503dd9b4e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.871838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e18bf-2945-4481-ba9f-d40503dd9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.872123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e18bf-2945-4481-ba9f-d40503dd9b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.872869 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e18bf-2945-4481-ba9f-d40503dd9b4e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:30.873174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e18bf-2945-4481-ba9f-d40503dd9b4e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.875025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e18bf-2945-4481-ba9f-d40503dd9b4e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.888344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 451/902] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:30.894565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:30.905576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052414-ae51-44d8-9811-8846c1b7d96a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:30.910459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de012e65-3f90-40bf-8444-2c872a9f23f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:30.911331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012e65-3f90-40bf-8444-2c872a9f23f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:30.911624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012e65-3f90-40bf-8444-2c872a9f23f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:30.911906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012e65-3f90-40bf-8444-2c872a9f23f4 admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/514d94b70d2d4b14b99a9b235942723e/roles/7aaa6f36ae64405697ffb965e125aae6` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:30.931598 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de012e65-3f90-40bf-8444-2c872a9f23f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=514d94b70d2d4b14b99a9b235942723e, role_id=7aaa6f36ae64405697ffb965e125aae6)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:30.934212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de012e65-3f90-40bf-8444-2c872a9f23f4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:30.947641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 452/903] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:43:30 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/514d94b70d2d4b14b99a9b235942723e/roles/7aaa6f36ae64405697ffb965e125aae6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:43:33.011839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2b7b-b14d-4c5e-ab7a-d80d8aea7b8e None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.012355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2b7b-b14d-4c5e-ab7a-d80d8aea7b8e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.012461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2b7b-b14d-4c5e-ab7a-d80d8aea7b8e None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.014048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 452/904] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:33.019238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443898ec-2155-475d-a6ce-1cd6725ec895 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.019620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443898ec-2155-475d-a6ce-1cd6725ec895 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.019806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443898ec-2155-475d-a6ce-1cd6725ec895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.041421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-443898ec-2155-475d-a6ce-1cd6725ec895 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:33.042624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-443898ec-2155-475d-a6ce-1cd6725ec895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:33.105371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 453/905] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:43:33.128547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a2b7b-b14d-4c5e-ab7a-d80d8aea7b8e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.140699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a2b7b-b14d-4c5e-ab7a-d80d8aea7b8e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.144668 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e427b8-df06-4e2d-8460-13726d6dd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.145372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e427b8-df06-4e2d-8460-13726d6dd63f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.145654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e427b8-df06-4e2d-8460-13726d6dd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.145928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e427b8-df06-4e2d-8460-13726d6dd63f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.156641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e427b8-df06-4e2d-8460-13726d6dd63f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:33.163051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-21e427b8-df06-4e2d-8460-13726d6dd63f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:43:33.164147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 453/906] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:33.170842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443898ec-2155-475d-a6ce-1cd6725ec895 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.179568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443898ec-2155-475d-a6ce-1cd6725ec895 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.184409 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.185002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.185290 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.185573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.186291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:33.186630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.188227 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.196399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 454/907] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:33.201898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e427b8-df06-4e2d-8460-13726d6dd63f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.211567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e427b8-df06-4e2d-8460-13726d6dd63f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.215671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.216373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.216657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.216932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.228308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.230116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.249511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:33.250662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 454/908] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:33.256504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.265824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06958112-f91f-4964-b17e-029c57bfe4d9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.270087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.270713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.271002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.271280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.271961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:33.272257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.273835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.285905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 455/909] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:33.292392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.302589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe77411-c285-440d-b431-2960a54e3ba5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.307732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.308479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.308770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.309051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.322727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.324764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.343041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 14:43:33.344192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 455/910] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:33.350091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.360444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdbed2-5d2a-4433-b247-604e9be71823 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.364544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.365138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.365425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.365705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.366549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:33.366852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.369293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.398383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 456/911] 10.222.0.57 () {56 vars in 1156 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:33.404439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.413806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999097d-e56a-481e-b67d-a4284d14459f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.418682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3972b-7234-4148-916f-943f4d97a6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.419256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3972b-7234-4148-916f-943f4d97a6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.419544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3972b-7234-4148-916f-943f4d97a6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.419823 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3972b-7234-4148-916f-943f4d97a6d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.427456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3972b-7234-4148-916f-943f4d97a6d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.429186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3972b-7234-4148-916f-943f4d97a6d8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.438342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 456/912] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:43:33.444370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.454184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a03d5-18e1-451e-803d-8651976352fb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.458358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.459098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.459380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.459729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.471890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.473712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.491581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:33.492698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 457/913] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:33.499419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3972b-7234-4148-916f-943f4d97a6d8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.508117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3972b-7234-4148-916f-943f4d97a6d8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.512473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.513052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.513342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.513623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.514314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:33.514650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.516210 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.529943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 457/914] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:33.535723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.545894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82b31c-9b8f-4d31-8ca1-33aadc66c565 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.550215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.550960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.551247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.551526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.560232 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.562168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.575825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:33.576915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 458/915] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:33.582894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.593257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee741b-09a6-4443-a743-e57572421a4d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.597565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71f496-ae34-49ed-b6bd-dfcf1efc8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.598143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f496-ae34-49ed-b6bd-dfcf1efc8744 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.598467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f496-ae34-49ed-b6bd-dfcf1efc8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.598753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f496-ae34-49ed-b6bd-dfcf1efc8744 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.599498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71f496-ae34-49ed-b6bd-dfcf1efc8744 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:33.599799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71f496-ae34-49ed-b6bd-dfcf1efc8744 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.601618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71f496-ae34-49ed-b6bd-dfcf1efc8744 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.615136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 458/916] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:33.621467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:33.631076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156190-d38c-4015-8299-10be8c2d839b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:33.635326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307898b-05d4-413e-8982-254027050c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:33.635905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307898b-05d4-413e-8982-254027050c85 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:33.636191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307898b-05d4-413e-8982-254027050c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:33.636470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307898b-05d4-413e-8982-254027050c85 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:33.637253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307898b-05d4-413e-8982-254027050c85 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=514d94b70d2d4b14b99a9b235942723e) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:33.637554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307898b-05d4-413e-8982-254027050c85 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:33.639444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307898b-05d4-413e-8982-254027050c85 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:33.645544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 459/917] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:43:33 2021] GET /identity/v3/role_assignments?user.id=514d94b70d2d4b14b99a9b235942723e&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:35.779145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278a46-f5cd-4e1d-95f2-0aea369c0320 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:35.779697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278a46-f5cd-4e1d-95f2-0aea369c0320 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:35.779697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278a46-f5cd-4e1d-95f2-0aea369c0320 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:35.781356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 459/918] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:35.786632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fb00f-c250-4857-9171-f5605d8a9ed0 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:35.787043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fb00f-c250-4857-9171-f5605d8a9ed0 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:35.787202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fb00f-c250-4857-9171-f5605d8a9ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:35.809606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-3d6fb00f-c250-4857-9171-f5605d8a9ed0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:35.810786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3d6fb00f-c250-4857-9171-f5605d8a9ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:35.817972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 460/919] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:35.840715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278a46-f5cd-4e1d-95f2-0aea369c0320 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:35.852304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278a46-f5cd-4e1d-95f2-0aea369c0320 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:35.856277 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619afb-8846-4f91-a4c7-f6741b70dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:35.856973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619afb-8846-4f91-a4c7-f6741b70dc19 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:35.857254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619afb-8846-4f91-a4c7-f6741b70dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:35.857524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619afb-8846-4f91-a4c7-f6741b70dc19 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:35.869142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34619afb-8846-4f91-a4c7-f6741b70dc19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:35.875473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-34619afb-8846-4f91-a4c7-f6741b70dc19 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:43:35.876531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 460/920] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:35.882563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fb00f-c250-4857-9171-f5605d8a9ed0 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:35.891960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fb00f-c250-4857-9171-f5605d8a9ed0 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:35.896266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:35.896861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:35.897151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:35.897431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:35.898141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:35.898474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:35.900064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:35.908496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 461/921] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:43:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:35.914177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619afb-8846-4f91-a4c7-f6741b70dc19 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:35.923928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619afb-8846-4f91-a4c7-f6741b70dc19 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:35.928064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:35.928765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:35.929047 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:35.929320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:35.940689 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:35.942507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:35.959779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:35.960874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 461/922] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:35.967043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:35.976406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed6cd9-149a-4429-b665-86377feae751 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:35.980683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:35.981264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:35.981554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:35.981836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:35.982559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:35.982861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:35.984681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:35.997261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 462/923] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:36.003016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:36.013042 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d32cf-46bc-484c-aa97-141152104741 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:36.017247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:36.017951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:36.018232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:36.018545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:36.030946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:36.032897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:36.051926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 14:43:36.053140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 462/924] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:36.059866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:36.069726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7f447-0322-4c61-8b60-db52f8f5704a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:36.074719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:36.075322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:36.075613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:36.075896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:36.076687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:36.076990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:36.078867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:36.107659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 463/925] 10.222.0.57 () {56 vars in 1156 bytes} [Mon Oct 25 14:43:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:36.113721 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:36.124801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a55411-fadf-4a84-a9b9-c4c154b31e51 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:36.130167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d3b06-27f8-4878-a76b-de54239f2b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:36.130771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d3b06-27f8-4878-a76b-de54239f2b9f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:36.131064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d3b06-27f8-4878-a76b-de54239f2b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:36.131346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d3b06-27f8-4878-a76b-de54239f2b9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:36.139750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d3b06-27f8-4878-a76b-de54239f2b9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:36.141484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d3b06-27f8-4878-a76b-de54239f2b9f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:36.150696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 463/926] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:43:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:43:36.156736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:36.166845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee6b4d-d23c-43ea-b792-85383ab882a7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:36.171111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:36.171834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:36.172124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:36.172406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:36.184532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:36.186351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:36.203666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:36.204791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 464/927] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:36.210680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d3b06-27f8-4878-a76b-de54239f2b9f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:36.219384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d3b06-27f8-4878-a76b-de54239f2b9f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:36.223646 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:36.224229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:36.224514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:36.224791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:36.225486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:36.225785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:36.227387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:36.240396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 464/928] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:36.247176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:36.256767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd5d37-b2c1-4ef6-bf8c-5d6607def7ef admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:36.261027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:36.261742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:36.262028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:36.262308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:36.270872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:36.272820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:36.286714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:36.287770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 465/929] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:36.294513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:36.303994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171dd85-8d81-47a8-83be-6dee0bd74b6c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:36.309016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8fd8a-f359-4212-8041-23e6940daea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:36.309600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8fd8a-f359-4212-8041-23e6940daea3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:36.309893 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8fd8a-f359-4212-8041-23e6940daea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:36.310174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8fd8a-f359-4212-8041-23e6940daea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:36.310972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8fd8a-f359-4212-8041-23e6940daea3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:36.311275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8fd8a-f359-4212-8041-23e6940daea3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:36.313099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8fd8a-f359-4212-8041-23e6940daea3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:36.326059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 465/930] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:36.332242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:36.341653 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d7c9-c711-456a-be24-8fb523e99b8d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:36.345921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9f4fd-1cef-47e5-995f-b9161d85fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:36.346523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f4fd-1cef-47e5-995f-b9161d85fbaa admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:36.346815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f4fd-1cef-47e5-995f-b9161d85fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:36.347097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f4fd-1cef-47e5-995f-b9161d85fbaa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:36.347865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9f4fd-1cef-47e5-995f-b9161d85fbaa admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=514d94b70d2d4b14b99a9b235942723e) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:36.348171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9f4fd-1cef-47e5-995f-b9161d85fbaa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:36.349985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9f4fd-1cef-47e5-995f-b9161d85fbaa admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:36.355839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 466/931] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:43:36 2021] GET /identity/v3/role_assignments?user.id=514d94b70d2d4b14b99a9b235942723e&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=98f77a1006404111a8be8686551c8675 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:38.434589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3dba5-2469-4eab-aab3-1d51432f72e5 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.435143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3dba5-2469-4eab-aab3-1d51432f72e5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.435143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3dba5-2469-4eab-aab3-1d51432f72e5 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.436830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 466/932] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:38.442042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b83b-495a-4f68-9028-0f4415ea6fca None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.442459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b83b-495a-4f68-9028-0f4415ea6fca None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.442638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b83b-495a-4f68-9028-0f4415ea6fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.465237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-87c3b83b-495a-4f68-9028-0f4415ea6fca None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:38.466376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-87c3b83b-495a-4f68-9028-0f4415ea6fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:38.473285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 467/933] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:38.495827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3dba5-2469-4eab-aab3-1d51432f72e5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.507527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3dba5-2469-4eab-aab3-1d51432f72e5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.512114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109dab-aa6d-47ee-b37d-f4cdaf1789dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.512818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109dab-aa6d-47ee-b37d-f4cdaf1789dd admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.513107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109dab-aa6d-47ee-b37d-f4cdaf1789dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.513393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109dab-aa6d-47ee-b37d-f4cdaf1789dd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.524376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00109dab-aa6d-47ee-b37d-f4cdaf1789dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:38.531366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-00109dab-aa6d-47ee-b37d-f4cdaf1789dd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:43:38.532477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 467/934] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:38.538539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3b83b-495a-4f68-9028-0f4415ea6fca None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.547257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3b83b-495a-4f68-9028-0f4415ea6fca None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.551436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.552021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.552308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.552588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.553293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:38.553589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.555204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.563552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 468/935] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:38.569219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109dab-aa6d-47ee-b37d-f4cdaf1789dd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.579520 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109dab-aa6d-47ee-b37d-f4cdaf1789dd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.583754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.584459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.584746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.585026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.596824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.599557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.620110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:38.621296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 468/936] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:38.627583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.638606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc219a-a372-4a5e-8d0c-875bc3c99e56 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.643086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.643668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.643951 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.644229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.644910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:38.645203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.646809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.660253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 469/937] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:38.666346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.676312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f49d-2031-4cfc-9ecb-634ada81a7b2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.680815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.681581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.681871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.682150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.697283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.698043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.716767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 14:43:38.717907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 469/938] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:38.723880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.733570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860667d2-34ef-4c63-bd9b-9467fcc6c404 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.737745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.738330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.738651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.738931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.739701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:38.739998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.741819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.772270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 470/939] 10.222.0.57 () {56 vars in 1156 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:38.778058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.787757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3e0d-e11c-45f4-890e-d96fb91757c3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.791968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.792679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.792963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.793239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.806631 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.808448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.826613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:38.827773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 470/940] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:43:38.833684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.843302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed4a2e-e97a-49a7-a407-a50733644dd9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.847511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.848099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.848390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.848669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.849360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:38.849654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.851285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.864098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 471/941] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:38.870396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.879859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d08a94-9ff9-49f4-9895-27bee1ad64ca admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.884664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.885386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.885672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.885949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.894602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.896552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.910172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:38.911327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 471/942] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:38.917381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.927716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b2572-2405-46aa-be6e-f3271a1b1d61 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.933486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523231e1-b5ab-4fe7-83fb-ed7528757cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.934091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523231e1-b5ab-4fe7-83fb-ed7528757cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.934375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523231e1-b5ab-4fe7-83fb-ed7528757cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.934856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523231e1-b5ab-4fe7-83fb-ed7528757cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.935441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523231e1-b5ab-4fe7-83fb-ed7528757cb4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:38.935959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523231e1-b5ab-4fe7-83fb-ed7528757cb4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.939173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523231e1-b5ab-4fe7-83fb-ed7528757cb4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.953058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 472/943] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:38.960482 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:38.969951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7383fa9-3586-4cbf-930c-ec4f18ae26c2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:38.974058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91645c3c-eb37-4c56-9259-b965ad916151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:38.974905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91645c3c-eb37-4c56-9259-b965ad916151 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:38.975186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91645c3c-eb37-4c56-9259-b965ad916151 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:38.975464 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91645c3c-eb37-4c56-9259-b965ad916151 admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/514d94b70d2d4b14b99a9b235942723e/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:38.977200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91645c3c-eb37-4c56-9259-b965ad916151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=514d94b70d2d4b14b99a9b235942723e, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:38.979818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91645c3c-eb37-4c56-9259-b965ad916151 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:38.992828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 472/944] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:43:38 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/514d94b70d2d4b14b99a9b235942723e/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:43:41.059076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397721-6590-47a1-bbc8-6798ecbf4d92 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.059648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397721-6590-47a1-bbc8-6798ecbf4d92 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.059648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397721-6590-47a1-bbc8-6798ecbf4d92 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.061312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 473/945] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:41.066491 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780d3ac-282e-45b7-b58f-3d144e221e86 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.066930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780d3ac-282e-45b7-b58f-3d144e221e86 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.067053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780d3ac-282e-45b7-b58f-3d144e221e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.089100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-9780d3ac-282e-45b7-b58f-3d144e221e86 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:41.090164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9780d3ac-282e-45b7-b58f-3d144e221e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:41.152245 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 473/946] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:43:41.177497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8397721-6590-47a1-bbc8-6798ecbf4d92 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.189433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8397721-6590-47a1-bbc8-6798ecbf4d92 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.193506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f832f6-5204-4fb5-9f40-bd4e0fc576f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.194288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f832f6-5204-4fb5-9f40-bd4e0fc576f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.194614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f832f6-5204-4fb5-9f40-bd4e0fc576f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.194897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f832f6-5204-4fb5-9f40-bd4e0fc576f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.205825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f832f6-5204-4fb5-9f40-bd4e0fc576f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:43:41.212866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-45f832f6-5204-4fb5-9f40-bd4e0fc576f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:43:41.213989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 474/947] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:41.219997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780d3ac-282e-45b7-b58f-3d144e221e86 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.229128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780d3ac-282e-45b7-b58f-3d144e221e86 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.233502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.234085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.234364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.234669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.235380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:41.235677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.237243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.245823 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 474/948] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:41.251481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f832f6-5204-4fb5-9f40-bd4e0fc576f2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.261205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f832f6-5204-4fb5-9f40-bd4e0fc576f2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.265399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.266104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.266393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.266699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.279158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.281017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.300386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:41.301588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 475/949] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:41.307705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.317121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c6eb-802f-448d-8e26-830b6b5533f2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.321290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.321871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.322155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.322461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.323150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:41.323444 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.325006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.337952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 475/950] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:41.343861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.353897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69dc04-6ae5-4990-b308-8f04d22ca42d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.358537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.359257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.359544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.359821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.372513 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.374603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.392514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 14:43:41.393604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 476/951] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:41.400087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.409298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebaaea2-05a1-427e-b13f-9ee12753d1f0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.416796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060687af-f429-4917-89e1-244b3817085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.417384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060687af-f429-4917-89e1-244b3817085c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.417668 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060687af-f429-4917-89e1-244b3817085c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.417943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060687af-f429-4917-89e1-244b3817085c admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.418760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060687af-f429-4917-89e1-244b3817085c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:41.419063 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060687af-f429-4917-89e1-244b3817085c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.420868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060687af-f429-4917-89e1-244b3817085c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.449157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 476/952] 10.222.0.57 () {56 vars in 1156 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:41.455082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.465023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe2da-4156-4a2e-909d-a213f16459d2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.469233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae45c6-b6c4-463f-95a5-d7bdc7b4bb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.469803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae45c6-b6c4-463f-95a5-d7bdc7b4bb0e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.470093 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae45c6-b6c4-463f-95a5-d7bdc7b4bb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.470377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae45c6-b6c4-463f-95a5-d7bdc7b4bb0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.478203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae45c6-b6c4-463f-95a5-d7bdc7b4bb0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.479985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae45c6-b6c4-463f-95a5-d7bdc7b4bb0e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.489418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 477/953] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:43:41.495440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060687af-f429-4917-89e1-244b3817085c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.504736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060687af-f429-4917-89e1-244b3817085c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.509476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.510196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.510510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.510885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.524127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.526626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.544107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:43:41.545344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 477/954] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:41.551208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae45c6-b6c4-463f-95a5-d7bdc7b4bb0e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.560445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae45c6-b6c4-463f-95a5-d7bdc7b4bb0e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.564799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.565556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.565673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.565938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.566673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:41.566974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.568566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.580745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 478/955] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:41.586745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.597101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12f22f-994a-4950-99d4-3f3485942ff2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.601202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.601913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.602194 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.603019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.611848 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.613771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.627817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:43:41.628917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 478/956] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:43:41.634950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.644419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac48b-4ce9-4827-a02b-bf31175b8bee admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.648573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6952b-5e7a-4345-b529-ce430b414e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.649152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6952b-5e7a-4345-b529-ce430b414e3a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.649441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6952b-5e7a-4345-b529-ce430b414e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.649722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6952b-5e7a-4345-b529-ce430b414e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.650494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6952b-5e7a-4345-b529-ce430b414e3a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:41.650797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6952b-5e7a-4345-b529-ce430b414e3a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.652627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6952b-5e7a-4345-b529-ce430b414e3a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.666346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 479/957] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:43:41.672545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:41.683174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57165aa4-61dc-432a-8381-f59ea87e3839 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:41.687291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3099baf-d64d-4545-88ef-b0dc95a7d00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:41.687855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3099baf-d64d-4545-88ef-b0dc95a7d00b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:41.688138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3099baf-d64d-4545-88ef-b0dc95a7d00b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:41.688413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3099baf-d64d-4545-88ef-b0dc95a7d00b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:41.689183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3099baf-d64d-4545-88ef-b0dc95a7d00b admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=514d94b70d2d4b14b99a9b235942723e) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:41.689482 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3099baf-d64d-4545-88ef-b0dc95a7d00b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:41.691323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3099baf-d64d-4545-88ef-b0dc95a7d00b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:41.697028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 479/958] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:43:41 2021] GET /identity/v3/role_assignments?user.id=514d94b70d2d4b14b99a9b235942723e&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=98f77a1006404111a8be8686551c8675 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:43.776716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799fecd-3dd5-4cdd-9c30-3fd8f6469ce3 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:43.777348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799fecd-3dd5-4cdd-9c30-3fd8f6469ce3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:43.777348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799fecd-3dd5-4cdd-9c30-3fd8f6469ce3 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:43.778993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 480/959] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:43.784131 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe809-a54c-45e6-8cd8-9415d8e06a96 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:43.784516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe809-a54c-45e6-8cd8-9415d8e06a96 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:43.784696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe809-a54c-45e6-8cd8-9415d8e06a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:43.806551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d7bbe809-a54c-45e6-8cd8-9415d8e06a96 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:43.807676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d7bbe809-a54c-45e6-8cd8-9415d8e06a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:43.814543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 480/960] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:43.837336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799fecd-3dd5-4cdd-9c30-3fd8f6469ce3 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:43.850697 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799fecd-3dd5-4cdd-9c30-3fd8f6469ce3 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:43.854734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:43.855453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:43.855737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:43.856014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:43.856629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:43.858541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:43.868982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 14:43:43.870026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 481/961] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:43:43 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:43.876052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe809-a54c-45e6-8cd8-9415d8e06a96 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:43.885077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe809-a54c-45e6-8cd8-9415d8e06a96 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:43.889195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618075ea-2a13-4509-89c0-334b129c3bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:43.889789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618075ea-2a13-4509-89c0-334b129c3bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:43.890056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618075ea-2a13-4509-89c0-334b129c3bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:43.890334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618075ea-2a13-4509-89c0-334b129c3bd7 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:43.891042 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618075ea-2a13-4509-89c0-334b129c3bd7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:43.891336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618075ea-2a13-4509-89c0-334b129c3bd7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:43.892908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618075ea-2a13-4509-89c0-334b129c3bd7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:43.897566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 481/962] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:43 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:43.903827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:43.913511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943b0c0-9c1f-4f73-812f-52fc3787d670 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:43.917868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e6054-4b12-44e1-90ac-3b7600784ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:43.918479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e6054-4b12-44e1-90ac-3b7600784ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:43.918771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e6054-4b12-44e1-90ac-3b7600784ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:43.919055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e6054-4b12-44e1-90ac-3b7600784ff8 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:43.919721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e6054-4b12-44e1-90ac-3b7600784ff8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:43.920019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e6054-4b12-44e1-90ac-3b7600784ff8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:43.921588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e6054-4b12-44e1-90ac-3b7600784ff8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:43.925970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 482/963] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:43 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:45.987045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a823a-666b-4f63-ad92-3ecc3eccd466 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:45.987579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a823a-666b-4f63-ad92-3ecc3eccd466 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:45.987579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a823a-666b-4f63-ad92-3ecc3eccd466 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:45.989395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 482/964] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:45.995443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d123d-3b7e-4954-8efa-65f743498a70 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:45.995902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d123d-3b7e-4954-8efa-65f743498a70 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:45.996013 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d123d-3b7e-4954-8efa-65f743498a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:46.017494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-be0d123d-3b7e-4954-8efa-65f743498a70 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:46.018704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-be0d123d-3b7e-4954-8efa-65f743498a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:46.025773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 483/965] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:46.048340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a823a-666b-4f63-ad92-3ecc3eccd466 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:46.060523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a823a-666b-4f63-ad92-3ecc3eccd466 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:46.064493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50446e36-7780-4a55-888b-a6c3c63c6cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:46.065060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446e36-7780-4a55-888b-a6c3c63c6cdc admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:46.065342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446e36-7780-4a55-888b-a6c3c63c6cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:46.065616 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446e36-7780-4a55-888b-a6c3c63c6cdc admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:46.066286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50446e36-7780-4a55-888b-a6c3c63c6cdc admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:46.067891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50446e36-7780-4a55-888b-a6c3c63c6cdc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:46.080463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 483/966] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:43:46 2021] POST /identity/v3/services => generated 241 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:43:48.183145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ae2a-030a-47fe-98c9-6c1e3fcf82c9 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:48.183666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ae2a-030a-47fe-98c9-6c1e3fcf82c9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:48.183666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ae2a-030a-47fe-98c9-6c1e3fcf82c9 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:48.185283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 484/967] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:48.190453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef27f43-e1d9-462d-9921-b2cca8aedcad None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:48.190827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef27f43-e1d9-462d-9921-b2cca8aedcad None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:48.191028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef27f43-e1d9-462d-9921-b2cca8aedcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:48.213606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8ef27f43-e1d9-462d-9921-b2cca8aedcad None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:48.214778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8ef27f43-e1d9-462d-9921-b2cca8aedcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:48.231627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 484/968] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:48 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:48.254097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ae2a-030a-47fe-98c9-6c1e3fcf82c9 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:48.266325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ae2a-030a-47fe-98c9-6c1e3fcf82c9 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:48.270483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:48.271206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:48.271495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:48.271775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:48.272396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:48.274021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:48.285449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 14:43:48.286569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 485/969] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:43:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:48.292643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef27f43-e1d9-462d-9921-b2cca8aedcad None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:48.301308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef27f43-e1d9-462d-9921-b2cca8aedcad None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:48.305547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:48.306129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:48.306439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:48.306731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:48.307408 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:48.307709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:48.309297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:48.313999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 485/970] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:48.319746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:48.329473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42024fb6-72da-46ca-9442-521512d86b8a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:48.333627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:48.334209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:48.334531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:48.334814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:48.335486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:48.335788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:48.337999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:48.344786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 486/971] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:48 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:48.352201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:48.362490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed218d46-95b6-46a5-8d64-d892320b2622 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:48.366677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab8f45-1dad-4d3b-ab5d-7b5de7b69fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:48.367256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab8f45-1dad-4d3b-ab5d-7b5de7b69fbe admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:48.367548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab8f45-1dad-4d3b-ab5d-7b5de7b69fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:48.367833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab8f45-1dad-4d3b-ab5d-7b5de7b69fbe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:48.368588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab8f45-1dad-4d3b-ab5d-7b5de7b69fbe admin admin] RBAC: Adding query filter params (interface=public, service_id=252a37056c4c4fd4abd735f53d8e9e48, region_id=RegionOne) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:48.368891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab8f45-1dad-4d3b-ab5d-7b5de7b69fbe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:48.370489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab8f45-1dad-4d3b-ab5d-7b5de7b69fbe admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:48.375595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 486/972] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:43:48 2021] GET /identity/v3/endpoints?service_id=252a37056c4c4fd4abd735f53d8e9e48&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:48.381204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:48.391271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e1cb8-aa7a-482f-8cf3-4e3bc06f31a3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:48.395659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd201e8-0079-479f-ab7f-16a4f0103eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:48.396265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd201e8-0079-479f-ab7f-16a4f0103eaf admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:48.396554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd201e8-0079-479f-ab7f-16a4f0103eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:48.396832 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd201e8-0079-479f-ab7f-16a4f0103eaf admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:48.397491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd201e8-0079-479f-ab7f-16a4f0103eaf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:48.399805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd201e8-0079-479f-ab7f-16a4f0103eaf admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:48.407290 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 487/973] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:43:48 2021] GET /identity/v3/services => generated 2196 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:43:50.484822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2722e1-c7b7-4d9f-99e6-ee0206080c3e None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:50.485345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2722e1-c7b7-4d9f-99e6-ee0206080c3e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:50.485455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2722e1-c7b7-4d9f-99e6-ee0206080c3e None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:50.487186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 487/974] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:50.492357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327906d-8fb3-42b6-94d1-cd2bae046f66 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:50.493348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327906d-8fb3-42b6-94d1-cd2bae046f66 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:50.493537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327906d-8fb3-42b6-94d1-cd2bae046f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:50.515001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0327906d-8fb3-42b6-94d1-cd2bae046f66 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:50.516131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0327906d-8fb3-42b6-94d1-cd2bae046f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:50.523112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 488/975] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:50 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:50.546133 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2722e1-c7b7-4d9f-99e6-ee0206080c3e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:50.558670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2722e1-c7b7-4d9f-99e6-ee0206080c3e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:50.562730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:50.563458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:50.563746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:50.564024 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:50.564643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:50.566202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:50.576905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 14:43:50.577972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 488/976] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:43:50 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:50.584123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327906d-8fb3-42b6-94d1-cd2bae046f66 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:50.592792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327906d-8fb3-42b6-94d1-cd2bae046f66 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:50.597055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:50.597644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:50.597935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:50.598216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:50.598929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:50.599244 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:50.600795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:50.606063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 489/977] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:50 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:50.611998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:50.621923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f7435-bf24-4e05-8842-1118ded2ffe3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:50.626098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b7c1-056e-4ca6-abd0-ec85f571b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:50.626734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b7c1-056e-4ca6-abd0-ec85f571b45a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:50.627001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b7c1-056e-4ca6-abd0-ec85f571b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:50.627279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b7c1-056e-4ca6-abd0-ec85f571b45a admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:50.627948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b7c1-056e-4ca6-abd0-ec85f571b45a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:50.628244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b7c1-056e-4ca6-abd0-ec85f571b45a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:50.629808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b7c1-056e-4ca6-abd0-ec85f571b45a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:50.634379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 489/978] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:50 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:50.640065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:50.649235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb10e4-2128-43c8-8432-abe093b2c4b9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:50.653401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201e09-5878-4ba3-b72e-602ec4f5edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:50.653976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201e09-5878-4ba3-b72e-602ec4f5edc1 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:50.654260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201e09-5878-4ba3-b72e-602ec4f5edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:50.654580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201e09-5878-4ba3-b72e-602ec4f5edc1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:50.655272 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201e09-5878-4ba3-b72e-602ec4f5edc1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:50.656831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201e09-5878-4ba3-b72e-602ec4f5edc1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:50.675876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 490/979] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:43:50 2021] POST /identity/v3/endpoints => generated 349 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:43:52.770539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8242-1210-4671-8a5e-b06d25c55350 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:52.771071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8242-1210-4671-8a5e-b06d25c55350 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:52.771193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8242-1210-4671-8a5e-b06d25c55350 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:52.772761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 490/980] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:52.777918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512809-a75f-4dab-97b8-f4e8405960cf None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:52.778287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512809-a75f-4dab-97b8-f4e8405960cf None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:52.778521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512809-a75f-4dab-97b8-f4e8405960cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:52.800535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-00512809-a75f-4dab-97b8-f4e8405960cf None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:52.801674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-00512809-a75f-4dab-97b8-f4e8405960cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:52.819579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 491/981] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:52 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:52.841816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a8242-1210-4671-8a5e-b06d25c55350 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:52.853980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a8242-1210-4671-8a5e-b06d25c55350 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:52.858235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:52.858985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:52.859267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:52.859546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:52.860165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:52.861838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:52.872952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 14:43:52.874007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 491/982] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:43:52 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:52.879975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00512809-a75f-4dab-97b8-f4e8405960cf None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:52.888606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00512809-a75f-4dab-97b8-f4e8405960cf None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:52.892781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:52.893364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:52.893647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:52.893923 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:52.894623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:52.894916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:52.896470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:52.901205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 492/983] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:43:52.906878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:52.918730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3a22-b879-4a7a-8bdf-6d71617443f7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:52.923031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:52.923607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:52.923891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:52.924169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:52.924842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:52.925140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:52.926733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:52.932034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 492/984] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:52 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:43:52.937987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:52.947285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b88e4-9f2b-4f1a-a804-2855ff0080ea admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:52.951533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589d71e-f205-465a-809b-63b80ee843b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:52.952137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d71e-f205-465a-809b-63b80ee843b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:52.952420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d71e-f205-465a-809b-63b80ee843b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:52.952698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d71e-f205-465a-809b-63b80ee843b6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:52.953455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d71e-f205-465a-809b-63b80ee843b6 admin admin] RBAC: Adding query filter params (interface=admin, service_id=252a37056c4c4fd4abd735f53d8e9e48, region_id=RegionOne) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:52.953754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d71e-f205-465a-809b-63b80ee843b6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:52.955428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d71e-f205-465a-809b-63b80ee843b6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:52.961509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 493/985] 10.222.0.57 () {56 vars in 1270 bytes} [Mon Oct 25 14:43:52 2021] GET /identity/v3/endpoints?service_id=252a37056c4c4fd4abd735f53d8e9e48&interface=admin®ion_id=RegionOne => generated 193 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:52.967549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:52.978067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd686ab-4639-42c0-8b5c-7333269bbd13 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:52.982505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aaaa6e-4cef-4c7d-81ee-198a26835e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:52.983367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaaa6e-4cef-4c7d-81ee-198a26835e31 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:52.983653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaaa6e-4cef-4c7d-81ee-198a26835e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:52.983932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaaa6e-4cef-4c7d-81ee-198a26835e31 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:52.984595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aaaa6e-4cef-4c7d-81ee-198a26835e31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:52.986193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aaaa6e-4cef-4c7d-81ee-198a26835e31 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:52.994163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 493/986] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:43:52 2021] GET /identity/v3/services => generated 2196 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:43:55.088200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711081-de91-4296-b9a5-5417993d7bed None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:55.088719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711081-de91-4296-b9a5-5417993d7bed None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:55.088719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711081-de91-4296-b9a5-5417993d7bed None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:55.090330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 494/987] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:55.095698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac9bc-1f44-4697-ae7a-0b276ce85c2d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:55.096117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac9bc-1f44-4697-ae7a-0b276ce85c2d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:55.096253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac9bc-1f44-4697-ae7a-0b276ce85c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:55.118026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7e0ac9bc-1f44-4697-ae7a-0b276ce85c2d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:55.119194 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7e0ac9bc-1f44-4697-ae7a-0b276ce85c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:55.126099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 494/988] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:55 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:55.148480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12711081-de91-4296-b9a5-5417993d7bed None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:55.160671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12711081-de91-4296-b9a5-5417993d7bed None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:55.164720 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:55.165437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:55.165720 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:55.165997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:55.166640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:55.168204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:55.179024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 14:43:55.180091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 495/989] 10.222.0.57 () {56 vars in 1147 bytes} [Mon Oct 25 14:43:55 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:43:55.186169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac9bc-1f44-4697-ae7a-0b276ce85c2d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:55.194758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac9bc-1f44-4697-ae7a-0b276ce85c2d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:55.199445 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:55.200015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:55.200295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:55.200568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:55.201233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:55.201525 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:55.203110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:55.207781 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 495/990] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:55 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:55.213918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:55.223154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66eec0-fc93-4e45-a448-5b9415cb1bd3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:55.227300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251aa75-ff72-4541-a8eb-10d7b92bdcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:55.227868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aa75-ff72-4541-a8eb-10d7b92bdcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:55.228149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aa75-ff72-4541-a8eb-10d7b92bdcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:55.228426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aa75-ff72-4541-a8eb-10d7b92bdcf0 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:55.229080 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251aa75-ff72-4541-a8eb-10d7b92bdcf0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:43:55.229373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251aa75-ff72-4541-a8eb-10d7b92bdcf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:55.230964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251aa75-ff72-4541-a8eb-10d7b92bdcf0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:55.235860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 496/991] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 25 14:43:55 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:55.241518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:55.251092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51d1b-8851-4824-9863-7588ec4c1243 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:55.255268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a889a-b230-4f37-bf5b-ff6ebd0a8b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:55.255830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a889a-b230-4f37-bf5b-ff6ebd0a8b6f admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:55.256113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a889a-b230-4f37-bf5b-ff6ebd0a8b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:55.256387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a889a-b230-4f37-bf5b-ff6ebd0a8b6f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:55.257072 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a889a-b230-4f37-bf5b-ff6ebd0a8b6f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:55.259271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a889a-b230-4f37-bf5b-ff6ebd0a8b6f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:55.273328 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 496/992] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:43:55 2021] POST /identity/v3/endpoints => generated 325 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:43:57.379146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d8bd-8f7f-4e3e-8ebe-229718f0c4ca None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:57.379677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d8bd-8f7f-4e3e-8ebe-229718f0c4ca None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:57.379795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d8bd-8f7f-4e3e-8ebe-229718f0c4ca None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:57.381366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 497/993] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:57.386624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a30c-9544-422d-8a45-b89496f01bc5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:57.387088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a30c-9544-422d-8a45-b89496f01bc5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:57.387181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a30c-9544-422d-8a45-b89496f01bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:57.408590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1182a30c-9544-422d-8a45-b89496f01bc5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:57.409730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1182a30c-9544-422d-8a45-b89496f01bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:57.428146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 497/994] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:43:57.451225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7d8bd-8f7f-4e3e-8ebe-229718f0c4ca None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:57.462881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7d8bd-8f7f-4e3e-8ebe-229718f0c4ca None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:57.466872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da106d-28c1-479b-8761-ff7118a81dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:57.467575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da106d-28c1-479b-8761-ff7118a81dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:57.467858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da106d-28c1-479b-8761-ff7118a81dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:57.468134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da106d-28c1-479b-8761-ff7118a81dc5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:57.469195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da106d-28c1-479b-8761-ff7118a81dc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:57.470909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da106d-28c1-479b-8761-ff7118a81dc5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:57.472339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 498/995] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:57.478794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182a30c-9544-422d-8a45-b89496f01bc5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:57.487671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182a30c-9544-422d-8a45-b89496f01bc5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:57.491911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9602b47-17c1-4343-ba8d-d1d28ac7f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:57.493107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602b47-17c1-4343-ba8d-d1d28ac7f695 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:57.493395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602b47-17c1-4343-ba8d-d1d28ac7f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:57.493678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602b47-17c1-4343-ba8d-d1d28ac7f695 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:57.494331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9602b47-17c1-4343-ba8d-d1d28ac7f695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:57.496223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9602b47-17c1-4343-ba8d-d1d28ac7f695 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:57.523082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 498/996] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:43:57 2021] POST /identity/v3/projects => generated 311 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:43:59.637711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b32b4b-71dd-4a8e-a4c6-0bf0b09b57c4 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:59.638280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b32b4b-71dd-4a8e-a4c6-0bf0b09b57c4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:59.638280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b32b4b-71dd-4a8e-a4c6-0bf0b09b57c4 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:59.639950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 499/997] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:43:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:43:59.645199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd5e3e-006d-4d99-bfc4-ee0b1d8eb9d9 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:59.645636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd5e3e-006d-4d99-bfc4-ee0b1d8eb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:59.645761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd5e3e-006d-4d99-bfc4-ee0b1d8eb9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:59.667711 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c0dd5e3e-006d-4d99-bfc4-ee0b1d8eb9d9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:43:59.668835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c0dd5e3e-006d-4d99-bfc4-ee0b1d8eb9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:43:59.730724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 499/998] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:43:59 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:43:59.755969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b32b4b-71dd-4a8e-a4c6-0bf0b09b57c4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:59.767564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b32b4b-71dd-4a8e-a4c6-0bf0b09b57c4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:59.771539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be6611-bdf4-4187-8f45-4f61bd05eddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:59.772246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be6611-bdf4-4187-8f45-4f61bd05eddb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:59.772527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be6611-bdf4-4187-8f45-4f61bd05eddb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:59.772802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be6611-bdf4-4187-8f45-4f61bd05eddb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:59.774348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be6611-bdf4-4187-8f45-4f61bd05eddb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:59.776054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be6611-bdf4-4187-8f45-4f61bd05eddb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:59.777492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 500/999] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:43:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:43:59.783224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd5e3e-006d-4d99-bfc4-ee0b1d8eb9d9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:43:59.792462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd5e3e-006d-4d99-bfc4-ee0b1d8eb9d9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:43:59.796671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238512fd-b747-4157-93b8-b61102045140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:43:59.797260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238512fd-b747-4157-93b8-b61102045140 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:43:59.797547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238512fd-b747-4157-93b8-b61102045140 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:43:59.797828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238512fd-b747-4157-93b8-b61102045140 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:43:59.798528 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238512fd-b747-4157-93b8-b61102045140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:43:59.800425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238512fd-b747-4157-93b8-b61102045140 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:43:59.819560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 500/1000] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:43:59 2021] POST /identity/v3/users => generated 285 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:44:01.956032 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccb567-d507-4b05-88eb-258c3c3b7df9 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:01.956561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccb567-d507-4b05-88eb-258c3c3b7df9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:01.956649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccb567-d507-4b05-88eb-258c3c3b7df9 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:01.958248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 501/1001] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:01.963667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5ac67-4e89-4719-9807-32a381b74b5a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:01.964049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5ac67-4e89-4719-9807-32a381b74b5a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:01.964236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5ac67-4e89-4719-9807-32a381b74b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:01.986543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-fcf5ac67-4e89-4719-9807-32a381b74b5a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:01.987683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fcf5ac67-4e89-4719-9807-32a381b74b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:01.995388 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 501/1002] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:44:02.018300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccb567-d507-4b05-88eb-258c3c3b7df9 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:02.030548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccb567-d507-4b05-88eb-258c3c3b7df9 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:02.034576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9471d2-c7e0-4cd8-a4dc-e9b799a2e94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:02.035284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9471d2-c7e0-4cd8-a4dc-e9b799a2e94f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:02.035568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9471d2-c7e0-4cd8-a4dc-e9b799a2e94f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:02.035842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9471d2-c7e0-4cd8-a4dc-e9b799a2e94f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:02.047638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9471d2-c7e0-4cd8-a4dc-e9b799a2e94f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:02.054190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-eb9471d2-c7e0-4cd8-a4dc-e9b799a2e94f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:02.055331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 502/1003] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:02.061295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5ac67-4e89-4719-9807-32a381b74b5a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:02.069960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5ac67-4e89-4719-9807-32a381b74b5a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:02.074252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:02.074822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:02.075112 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:02.075396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:02.076109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:02.076409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:02.077979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:02.086941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 502/1004] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:02.092726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9471d2-c7e0-4cd8-a4dc-e9b799a2e94f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:02.102815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9471d2-c7e0-4cd8-a4dc-e9b799a2e94f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:02.106986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f1a55-21f6-4355-aa49-10a9dd6c0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:02.108023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1a55-21f6-4355-aa49-10a9dd6c0102 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:02.108314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1a55-21f6-4355-aa49-10a9dd6c0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:02.108588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1a55-21f6-4355-aa49-10a9dd6c0102 admin admin] PATH_INFO: `/v3/users/d2b7d5248d40416a8d2ba7fde7fe66f7` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:02.127700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f1a55-21f6-4355-aa49-10a9dd6c0102 admin admin] RBAC: Authorizing `identity:get_user(user_id=d2b7d5248d40416a8d2ba7fde7fe66f7)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:02.129817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f1a55-21f6-4355-aa49-10a9dd6c0102 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:02.131384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 503/1005] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:02 2021] GET /identity/v3/users/d2b7d5248d40416a8d2ba7fde7fe66f7 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:02.137339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:02.147356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e3574-df1f-4ca7-a58b-0e749f536d8f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:02.152371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae00c5-28e1-4424-af11-3eacb9728e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:02.152974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae00c5-28e1-4424-af11-3eacb9728e5d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:02.153266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae00c5-28e1-4424-af11-3eacb9728e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:02.153552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae00c5-28e1-4424-af11-3eacb9728e5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:02.162376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae00c5-28e1-4424-af11-3eacb9728e5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:02.164837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae00c5-28e1-4424-af11-3eacb9728e5d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:02.174728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 503/1006] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:02 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:44:02.180940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f1a55-21f6-4355-aa49-10a9dd6c0102 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:02.190648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f1a55-21f6-4355-aa49-10a9dd6c0102 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:02.194918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611bf9a-a7be-431e-b03a-57cc199037c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:02.195700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bf9a-a7be-431e-b03a-57cc199037c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:02.195985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bf9a-a7be-431e-b03a-57cc199037c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:02.196264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bf9a-a7be-431e-b03a-57cc199037c1 admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:02.197353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611bf9a-a7be-431e-b03a-57cc199037c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e60040c3d40b41448eaac9c9bb40dc84)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:02.199425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611bf9a-a7be-431e-b03a-57cc199037c1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:02.200962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 504/1007] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:02 2021] GET /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:02.207150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae00c5-28e1-4424-af11-3eacb9728e5d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:02.216573 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae00c5-28e1-4424-af11-3eacb9728e5d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:02.220999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30052b-d41d-4f23-b034-aaa015d02f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:02.221569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30052b-d41d-4f23-b034-aaa015d02f30 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:02.221850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30052b-d41d-4f23-b034-aaa015d02f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:02.222128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30052b-d41d-4f23-b034-aaa015d02f30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:02.222942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30052b-d41d-4f23-b034-aaa015d02f30 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=e60040c3d40b41448eaac9c9bb40dc84, user.id=d2b7d5248d40416a8d2ba7fde7fe66f7) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:02.223240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30052b-d41d-4f23-b034-aaa015d02f30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:02.225050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30052b-d41d-4f23-b034-aaa015d02f30 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:02.231071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 504/1008] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:44:02 2021] GET /identity/v3/role_assignments?user.id=d2b7d5248d40416a8d2ba7fde7fe66f7&scope.project.id=e60040c3d40b41448eaac9c9bb40dc84&role.id=98f77a1006404111a8be8686551c8675 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:04.290711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a9eb-c6cc-4c85-8fa0-e5cbbd61b7df None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:04.291208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a9eb-c6cc-4c85-8fa0-e5cbbd61b7df None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:04.291208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a9eb-c6cc-4c85-8fa0-e5cbbd61b7df None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:04.292871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 505/1009] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:04.297878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c591-154e-473a-b13b-e5b6d9401f87 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:04.298282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c591-154e-473a-b13b-e5b6d9401f87 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:04.298467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c591-154e-473a-b13b-e5b6d9401f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:04.320864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-3313c591-154e-473a-b13b-e5b6d9401f87 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:04.321983 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-3313c591-154e-473a-b13b-e5b6d9401f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:04.328901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 505/1010] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:44:04.351066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3a9eb-c6cc-4c85-8fa0-e5cbbd61b7df None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:04.363225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3a9eb-c6cc-4c85-8fa0-e5cbbd61b7df None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:04.367787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f347fe0-f768-4416-8551-d9bcc926cd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:04.368496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f347fe0-f768-4416-8551-d9bcc926cd0a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:04.368782 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f347fe0-f768-4416-8551-d9bcc926cd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:04.369062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f347fe0-f768-4416-8551-d9bcc926cd0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:04.379984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f347fe0-f768-4416-8551-d9bcc926cd0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:04.387022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-9f347fe0-f768-4416-8551-d9bcc926cd0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:04.388112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 506/1011] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:04.394213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313c591-154e-473a-b13b-e5b6d9401f87 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:04.402828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313c591-154e-473a-b13b-e5b6d9401f87 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:04.406982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:04.407565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:04.407850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:04.408131 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:04.408844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:04.409143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:04.410747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:04.419015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 506/1012] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:04.424723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f347fe0-f768-4416-8551-d9bcc926cd0a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:04.435042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f347fe0-f768-4416-8551-d9bcc926cd0a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:04.439252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7571d-c302-48a8-9cb5-80595efd445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:04.440029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7571d-c302-48a8-9cb5-80595efd445a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:04.440314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7571d-c302-48a8-9cb5-80595efd445a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:04.440590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7571d-c302-48a8-9cb5-80595efd445a admin admin] PATH_INFO: `/v3/users/d2b7d5248d40416a8d2ba7fde7fe66f7` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:04.441683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7571d-c302-48a8-9cb5-80595efd445a admin admin] RBAC: Authorizing `identity:get_user(user_id=d2b7d5248d40416a8d2ba7fde7fe66f7)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:04.443828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7571d-c302-48a8-9cb5-80595efd445a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:04.445813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 507/1013] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:04 2021] GET /identity/v3/users/d2b7d5248d40416a8d2ba7fde7fe66f7 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:04.451613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:04.460906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f61f73-0509-4c73-b24b-5834b7463dac admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:04.465043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d92a92-a026-4c5c-9574-8697db2d5a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:04.465819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d92a92-a026-4c5c-9574-8697db2d5a32 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:04.466110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d92a92-a026-4c5c-9574-8697db2d5a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:04.466395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d92a92-a026-4c5c-9574-8697db2d5a32 admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:04.467523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d92a92-a026-4c5c-9574-8697db2d5a32 admin admin] RBAC: Authorizing `identity:get_project(project_id=e60040c3d40b41448eaac9c9bb40dc84)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:04.469545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d92a92-a026-4c5c-9574-8697db2d5a32 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:04.471120 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 507/1014] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:04 2021] GET /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:04.476792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7571d-c302-48a8-9cb5-80595efd445a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:04.486290 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7571d-c302-48a8-9cb5-80595efd445a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:04.490602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291484f-3073-4f64-9bce-733fa5d97014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:04.491448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291484f-3073-4f64-9bce-733fa5d97014 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:04.491739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291484f-3073-4f64-9bce-733fa5d97014 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:04.492517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291484f-3073-4f64-9bce-733fa5d97014 admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84/users/d2b7d5248d40416a8d2ba7fde7fe66f7/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:04.494392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291484f-3073-4f64-9bce-733fa5d97014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60040c3d40b41448eaac9c9bb40dc84, user_id=d2b7d5248d40416a8d2ba7fde7fe66f7, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:04.497104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291484f-3073-4f64-9bce-733fa5d97014 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:04.512471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 508/1015] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:44:04 2021] PUT /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84/users/d2b7d5248d40416a8d2ba7fde7fe66f7/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:44:06.560647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc43c-9d25-4750-88aa-e325077cb84f None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:06.561183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc43c-9d25-4750-88aa-e325077cb84f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:06.561183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc43c-9d25-4750-88aa-e325077cb84f None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:06.562888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 508/1016] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:06.568205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80d20-9263-4e8b-81f3-2296072b1071 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:06.568579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80d20-9263-4e8b-81f3-2296072b1071 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:06.568768 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80d20-9263-4e8b-81f3-2296072b1071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:06.590775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-01c80d20-9263-4e8b-81f3-2296072b1071 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:06.591914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-01c80d20-9263-4e8b-81f3-2296072b1071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:06.655537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 509/1017] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:06.678202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc43c-9d25-4750-88aa-e325077cb84f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:06.690340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc43c-9d25-4750-88aa-e325077cb84f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:06.694392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f9dd-73fe-4948-bc29-815974cea2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:06.695716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f9dd-73fe-4948-bc29-815974cea2cf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:06.696000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f9dd-73fe-4948-bc29-815974cea2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:06.696275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f9dd-73fe-4948-bc29-815974cea2cf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:06.707270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17f9dd-73fe-4948-bc29-815974cea2cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:06.713577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-ac17f9dd-73fe-4948-bc29-815974cea2cf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:06.714674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 509/1018] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:06.720703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c80d20-9263-4e8b-81f3-2296072b1071 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:06.729284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c80d20-9263-4e8b-81f3-2296072b1071 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:06.733771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:06.734361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:06.734679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:06.734959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:06.735669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:06.735966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:06.737540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:06.746414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 510/1019] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:06.752126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f9dd-73fe-4948-bc29-815974cea2cf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:06.761996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f9dd-73fe-4948-bc29-815974cea2cf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:06.766231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4a5b-4d19-4c4a-8a24-940ab8b3c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:06.767049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4a5b-4d19-4c4a-8a24-940ab8b3c17d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:06.767340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4a5b-4d19-4c4a-8a24-940ab8b3c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:06.767623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4a5b-4d19-4c4a-8a24-940ab8b3c17d admin admin] PATH_INFO: `/v3/users/d2b7d5248d40416a8d2ba7fde7fe66f7` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:06.768728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4a5b-4d19-4c4a-8a24-940ab8b3c17d admin admin] RBAC: Authorizing `identity:get_user(user_id=d2b7d5248d40416a8d2ba7fde7fe66f7)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:06.770891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4a5b-4d19-4c4a-8a24-940ab8b3c17d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:06.772356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 510/1020] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:06 2021] GET /identity/v3/users/d2b7d5248d40416a8d2ba7fde7fe66f7 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:06.778067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:06.787353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bb741-06ea-4f74-9322-ed5ad4b889d2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:06.791592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfff5c7-ea70-4076-a585-4e1e9cfa6498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:06.792166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfff5c7-ea70-4076-a585-4e1e9cfa6498 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:06.792455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfff5c7-ea70-4076-a585-4e1e9cfa6498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:06.792739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfff5c7-ea70-4076-a585-4e1e9cfa6498 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:06.801247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfff5c7-ea70-4076-a585-4e1e9cfa6498 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:06.803061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfff5c7-ea70-4076-a585-4e1e9cfa6498 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:06.813986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 511/1021] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:06 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:44:06.821050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4a5b-4d19-4c4a-8a24-940ab8b3c17d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:06.831041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4a5b-4d19-4c4a-8a24-940ab8b3c17d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:06.835429 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdbcce-6184-4720-b855-3355a504b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:06.836225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbcce-6184-4720-b855-3355a504b3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:06.836509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbcce-6184-4720-b855-3355a504b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:06.836786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbcce-6184-4720-b855-3355a504b3f0 admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:06.837874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdbcce-6184-4720-b855-3355a504b3f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=e60040c3d40b41448eaac9c9bb40dc84)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:06.839941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdbcce-6184-4720-b855-3355a504b3f0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:06.841513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 511/1022] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:06 2021] GET /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:06.847722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfff5c7-ea70-4076-a585-4e1e9cfa6498 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:06.856629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfff5c7-ea70-4076-a585-4e1e9cfa6498 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:06.861196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bcd7e-7814-428f-b4ca-efa4c649ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:06.861776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bcd7e-7814-428f-b4ca-efa4c649ae52 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:06.862066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bcd7e-7814-428f-b4ca-efa4c649ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:06.862348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bcd7e-7814-428f-b4ca-efa4c649ae52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:06.863155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bcd7e-7814-428f-b4ca-efa4c649ae52 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=e60040c3d40b41448eaac9c9bb40dc84, user.id=d2b7d5248d40416a8d2ba7fde7fe66f7) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:06.863460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bcd7e-7814-428f-b4ca-efa4c649ae52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:06.865295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bcd7e-7814-428f-b4ca-efa4c649ae52 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:06.871602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 512/1023] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:44:06 2021] GET /identity/v3/role_assignments?user.id=d2b7d5248d40416a8d2ba7fde7fe66f7&scope.project.id=e60040c3d40b41448eaac9c9bb40dc84&role.id=98f77a1006404111a8be8686551c8675 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:08.982383 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b5ab-e931-40b2-9239-5ec98aa57bee None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:08.983176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b5ab-e931-40b2-9239-5ec98aa57bee None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:08.983289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b5ab-e931-40b2-9239-5ec98aa57bee None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:08.984883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 512/1024] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:08.990028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36d090-583a-4634-9eeb-3ae77c1e80e1 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:08.990473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36d090-583a-4634-9eeb-3ae77c1e80e1 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:08.990616 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36d090-583a-4634-9eeb-3ae77c1e80e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:09.013381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-3f36d090-583a-4634-9eeb-3ae77c1e80e1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:09.014562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3f36d090-583a-4634-9eeb-3ae77c1e80e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:09.021594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 513/1025] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:09.045364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605b5ab-e931-40b2-9239-5ec98aa57bee None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:09.057479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605b5ab-e931-40b2-9239-5ec98aa57bee None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:09.061477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9d5ce-7b73-46fa-ae4e-921adbb54e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:09.062544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9d5ce-7b73-46fa-ae4e-921adbb54e02 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:09.062829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9d5ce-7b73-46fa-ae4e-921adbb54e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:09.063106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9d5ce-7b73-46fa-ae4e-921adbb54e02 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:09.064182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9d5ce-7b73-46fa-ae4e-921adbb54e02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:09.065828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9d5ce-7b73-46fa-ae4e-921adbb54e02 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:09.067299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 513/1026] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:44:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:44:09.073612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36d090-583a-4634-9eeb-3ae77c1e80e1 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:09.084331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36d090-583a-4634-9eeb-3ae77c1e80e1 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:09.093365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ffccb-0305-4809-94c6-1ae64b6bf1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:09.093976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffccb-0305-4809-94c6-1ae64b6bf1cb admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:09.094265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffccb-0305-4809-94c6-1ae64b6bf1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:09.094578 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffccb-0305-4809-94c6-1ae64b6bf1cb admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:09.095237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ffccb-0305-4809-94c6-1ae64b6bf1cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:09.097150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ffccb-0305-4809-94c6-1ae64b6bf1cb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:09.117143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 514/1027] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:44:09 2021] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:44:11.283233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130f89-1f92-4d2b-9817-f506e807ab6d None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:11.283780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130f89-1f92-4d2b-9817-f506e807ab6d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:11.283780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130f89-1f92-4d2b-9817-f506e807ab6d None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:11.285373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 514/1028] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:11.291193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c31a-f9ea-4a26-bcb3-606b2bb56d29 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:11.291630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c31a-f9ea-4a26-bcb3-606b2bb56d29 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:11.291763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c31a-f9ea-4a26-bcb3-606b2bb56d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:11.313337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-d430c31a-f9ea-4a26-bcb3-606b2bb56d29 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:11.314514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d430c31a-f9ea-4a26-bcb3-606b2bb56d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:11.321501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 515/1029] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:11 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:11.344755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41130f89-1f92-4d2b-9817-f506e807ab6d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:11.357184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41130f89-1f92-4d2b-9817-f506e807ab6d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:11.361561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:11.362327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:11.362643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:11.362918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] PATH_INFO: `/v3/roles/9aea1c8bef3a4845b02455d1934a3771` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:11.364252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] RBAC: Authorizing `identity:get_role(role_id=9aea1c8bef3a4845b02455d1934a3771)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:11.365270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:44:11.365270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:44:11.365270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:44:11.366136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:11.367885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 515/1030] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:11 2021] GET /identity/v3/roles/9aea1c8bef3a4845b02455d1934a3771 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:11.373904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c31a-f9ea-4a26-bcb3-606b2bb56d29 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:11.383183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c31a-f9ea-4a26-bcb3-606b2bb56d29 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:11.387488 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6910c0-6f2c-4836-b479-562b38c3e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:11.388284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6910c0-6f2c-4836-b479-562b38c3e5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:11.388573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6910c0-6f2c-4836-b479-562b38c3e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:11.388855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6910c0-6f2c-4836-b479-562b38c3e5a9 admin admin] PATH_INFO: `/v3/users/61aa1524a1474060a047f21c5287fb3e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:11.407254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6910c0-6f2c-4836-b479-562b38c3e5a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=61aa1524a1474060a047f21c5287fb3e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:11.409381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6910c0-6f2c-4836-b479-562b38c3e5a9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:11.410939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 516/1031] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:11 2021] GET /identity/v3/users/61aa1524a1474060a047f21c5287fb3e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:11.416774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:11.426014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e860f-d288-4cb6-8bb6-e147c28bd453 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:11.430355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1e92-56f8-4137-b608-6221a2a432be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:11.430944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1e92-56f8-4137-b608-6221a2a432be admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:11.431228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1e92-56f8-4137-b608-6221a2a432be admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:11.431508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1e92-56f8-4137-b608-6221a2a432be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:11.439021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1e92-56f8-4137-b608-6221a2a432be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:11.440731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1e92-56f8-4137-b608-6221a2a432be admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:11.449680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 516/1032] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:11 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:44:11.455703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6910c0-6f2c-4836-b479-562b38c3e5a9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:11.465630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6910c0-6f2c-4836-b479-562b38c3e5a9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:11.469886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6f1ff-06d2-4b5a-8024-d5e2fdc2a2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:11.470716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f1ff-06d2-4b5a-8024-d5e2fdc2a2ef admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:11.471008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f1ff-06d2-4b5a-8024-d5e2fdc2a2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:11.471291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f1ff-06d2-4b5a-8024-d5e2fdc2a2ef admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:11.472427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6f1ff-06d2-4b5a-8024-d5e2fdc2a2ef admin admin] RBAC: Authorizing `identity:get_project(project_id=e60040c3d40b41448eaac9c9bb40dc84)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:11.474551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6f1ff-06d2-4b5a-8024-d5e2fdc2a2ef admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:11.476265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 517/1033] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:11 2021] GET /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:11.483195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1e92-56f8-4137-b608-6221a2a432be admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:11.492377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1e92-56f8-4137-b608-6221a2a432be admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:11.496970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d71667-ae1b-46ed-8203-06bf73b9e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:11.497567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71667-ae1b-46ed-8203-06bf73b9e4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:11.497858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71667-ae1b-46ed-8203-06bf73b9e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:11.498141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71667-ae1b-46ed-8203-06bf73b9e4c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:11.498997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d71667-ae1b-46ed-8203-06bf73b9e4c9 admin admin] RBAC: Adding query filter params (role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=e60040c3d40b41448eaac9c9bb40dc84, user.id=61aa1524a1474060a047f21c5287fb3e) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:11.499302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d71667-ae1b-46ed-8203-06bf73b9e4c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:11.501171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d71667-ae1b-46ed-8203-06bf73b9e4c9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:11.512021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 517/1034] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:44:11 2021] GET /identity/v3/role_assignments?user.id=61aa1524a1474060a047f21c5287fb3e&scope.project.id=e60040c3d40b41448eaac9c9bb40dc84&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:13.572426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a09eb7-fb75-4945-883f-ae6a31e31053 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:13.572988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a09eb7-fb75-4945-883f-ae6a31e31053 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:13.572988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a09eb7-fb75-4945-883f-ae6a31e31053 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:13.574676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 518/1035] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:13.579760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c23c63-8ad0-4c96-bb89-fe18f3146d3c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:13.580185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c23c63-8ad0-4c96-bb89-fe18f3146d3c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:13.580332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c23c63-8ad0-4c96-bb89-fe18f3146d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:13.601805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d8c23c63-8ad0-4c96-bb89-fe18f3146d3c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:13.602981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d8c23c63-8ad0-4c96-bb89-fe18f3146d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:13.610388 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 518/1036] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:13.633856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a09eb7-fb75-4945-883f-ae6a31e31053 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:13.645635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a09eb7-fb75-4945-883f-ae6a31e31053 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:13.649726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:13.650530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:13.650823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:13.651100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] PATH_INFO: `/v3/roles/9aea1c8bef3a4845b02455d1934a3771` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:13.652452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] RBAC: Authorizing `identity:get_role(role_id=9aea1c8bef3a4845b02455d1934a3771)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:13.653453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:44:13.653453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:44:13.653453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:44:13.654317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:13.655592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 519/1037] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:13 2021] GET /identity/v3/roles/9aea1c8bef3a4845b02455d1934a3771 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:13.661366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c23c63-8ad0-4c96-bb89-fe18f3146d3c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:13.671316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c23c63-8ad0-4c96-bb89-fe18f3146d3c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:13.675657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c4efa-6dc6-4c09-afa4-4eed0b98076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:13.676456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4efa-6dc6-4c09-afa4-4eed0b98076b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:13.676743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4efa-6dc6-4c09-afa4-4eed0b98076b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:13.677022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4efa-6dc6-4c09-afa4-4eed0b98076b admin admin] PATH_INFO: `/v3/users/61aa1524a1474060a047f21c5287fb3e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:13.678124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c4efa-6dc6-4c09-afa4-4eed0b98076b admin admin] RBAC: Authorizing `identity:get_user(user_id=61aa1524a1474060a047f21c5287fb3e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:13.681275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c4efa-6dc6-4c09-afa4-4eed0b98076b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:13.682794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 519/1038] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:13 2021] GET /identity/v3/users/61aa1524a1474060a047f21c5287fb3e => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:13.688656 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:13.698057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56800f8-3f89-45cf-aebc-2824de4027df admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:13.702254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252432e7-beac-45b5-85f4-f4b8aa51bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:13.703073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252432e7-beac-45b5-85f4-f4b8aa51bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:13.703362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252432e7-beac-45b5-85f4-f4b8aa51bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:13.703643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252432e7-beac-45b5-85f4-f4b8aa51bd06 admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:13.704721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252432e7-beac-45b5-85f4-f4b8aa51bd06 admin admin] RBAC: Authorizing `identity:get_project(project_id=e60040c3d40b41448eaac9c9bb40dc84)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:13.706780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252432e7-beac-45b5-85f4-f4b8aa51bd06 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:13.708296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 520/1039] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:13 2021] GET /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:13.714031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c4efa-6dc6-4c09-afa4-4eed0b98076b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:13.723310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c4efa-6dc6-4c09-afa4-4eed0b98076b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:13.728332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0dedc8-7638-42d0-8636-3191e8d9babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:13.729301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dedc8-7638-42d0-8636-3191e8d9babe admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:13.729591 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dedc8-7638-42d0-8636-3191e8d9babe admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:13.729871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dedc8-7638-42d0-8636-3191e8d9babe admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84/users/61aa1524a1474060a047f21c5287fb3e/roles/9aea1c8bef3a4845b02455d1934a3771` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:13.732037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0dedc8-7638-42d0-8636-3191e8d9babe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60040c3d40b41448eaac9c9bb40dc84, user_id=61aa1524a1474060a047f21c5287fb3e, role_id=9aea1c8bef3a4845b02455d1934a3771)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:13.734958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0dedc8-7638-42d0-8636-3191e8d9babe admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:13.748378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 520/1040] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:44:13 2021] PUT /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84/users/61aa1524a1474060a047f21c5287fb3e/roles/9aea1c8bef3a4845b02455d1934a3771 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:44:15.813210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd368d3-bfb0-4cb2-b90e-7577e5faf6fe None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:15.813767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd368d3-bfb0-4cb2-b90e-7577e5faf6fe None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:15.813767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd368d3-bfb0-4cb2-b90e-7577e5faf6fe None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:15.815474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 521/1041] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:15.821418 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad4c10-7857-4a60-ab5a-2d5ebe6b33d5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:15.821850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad4c10-7857-4a60-ab5a-2d5ebe6b33d5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:15.822120 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad4c10-7857-4a60-ab5a-2d5ebe6b33d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:15.843775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-3cad4c10-7857-4a60-ab5a-2d5ebe6b33d5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:15.844920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-3cad4c10-7857-4a60-ab5a-2d5ebe6b33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:15.911186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 521/1042] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:15 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:44:15.935489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd368d3-bfb0-4cb2-b90e-7577e5faf6fe None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:15.947387 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd368d3-bfb0-4cb2-b90e-7577e5faf6fe None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:15.951584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204166c5-3012-4669-8f60-607c57bdd575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:15.952360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204166c5-3012-4669-8f60-607c57bdd575 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:15.952651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204166c5-3012-4669-8f60-607c57bdd575 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:15.952933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204166c5-3012-4669-8f60-607c57bdd575 admin admin] PATH_INFO: `/v3/roles/9aea1c8bef3a4845b02455d1934a3771` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:15.954278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204166c5-3012-4669-8f60-607c57bdd575 admin admin] RBAC: Authorizing `identity:get_role(role_id=9aea1c8bef3a4845b02455d1934a3771)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:15.955892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204166c5-3012-4669-8f60-607c57bdd575 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:15.957168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 522/1043] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:15 2021] GET /identity/v3/roles/9aea1c8bef3a4845b02455d1934a3771 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:15.963133 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad4c10-7857-4a60-ab5a-2d5ebe6b33d5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:15.972047 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad4c10-7857-4a60-ab5a-2d5ebe6b33d5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:15.977097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98cda4-3c82-41e7-9e20-be947396868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:15.977925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98cda4-3c82-41e7-9e20-be947396868d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:15.978217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98cda4-3c82-41e7-9e20-be947396868d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:15.978539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98cda4-3c82-41e7-9e20-be947396868d admin admin] PATH_INFO: `/v3/users/61aa1524a1474060a047f21c5287fb3e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:15.979734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98cda4-3c82-41e7-9e20-be947396868d admin admin] RBAC: Authorizing `identity:get_user(user_id=61aa1524a1474060a047f21c5287fb3e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:15.981959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98cda4-3c82-41e7-9e20-be947396868d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:15.983872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 522/1044] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:15 2021] GET /identity/v3/users/61aa1524a1474060a047f21c5287fb3e => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:15.990286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204166c5-3012-4669-8f60-607c57bdd575 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:16.000902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204166c5-3012-4669-8f60-607c57bdd575 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:16.005378 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832b2b3-33cd-4368-95c2-18ffbe20f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:16.005972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b2b3-33cd-4368-95c2-18ffbe20f452 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:16.006265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b2b3-33cd-4368-95c2-18ffbe20f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:16.006596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b2b3-33cd-4368-95c2-18ffbe20f452 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:16.015190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832b2b3-33cd-4368-95c2-18ffbe20f452 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:16.016937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832b2b3-33cd-4368-95c2-18ffbe20f452 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:16.025676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 523/1045] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:15 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:44:16.031779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98cda4-3c82-41e7-9e20-be947396868d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:16.041716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98cda4-3c82-41e7-9e20-be947396868d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:16.045937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee3eb0-9fab-49f3-a31c-6471e2be4a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:16.046757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3eb0-9fab-49f3-a31c-6471e2be4a1b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:16.047046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3eb0-9fab-49f3-a31c-6471e2be4a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:16.047327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3eb0-9fab-49f3-a31c-6471e2be4a1b admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:16.048411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee3eb0-9fab-49f3-a31c-6471e2be4a1b admin admin] RBAC: Authorizing `identity:get_project(project_id=e60040c3d40b41448eaac9c9bb40dc84)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:16.050454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee3eb0-9fab-49f3-a31c-6471e2be4a1b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:16.051999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 523/1046] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:16 2021] GET /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:16.059007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832b2b3-33cd-4368-95c2-18ffbe20f452 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:16.067650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832b2b3-33cd-4368-95c2-18ffbe20f452 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:16.071954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862091e-42db-4ab3-a39f-ce9d8b9e079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:16.072529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862091e-42db-4ab3-a39f-ce9d8b9e079d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:16.072817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862091e-42db-4ab3-a39f-ce9d8b9e079d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:16.073098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862091e-42db-4ab3-a39f-ce9d8b9e079d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:16.073867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862091e-42db-4ab3-a39f-ce9d8b9e079d admin admin] RBAC: Adding query filter params (role.id=9aea1c8bef3a4845b02455d1934a3771, scope.project.id=e60040c3d40b41448eaac9c9bb40dc84, user.id=61aa1524a1474060a047f21c5287fb3e) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:16.074170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862091e-42db-4ab3-a39f-ce9d8b9e079d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:16.076035 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862091e-42db-4ab3-a39f-ce9d8b9e079d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:16.081698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 524/1047] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:44:16 2021] GET /identity/v3/role_assignments?user.id=61aa1524a1474060a047f21c5287fb3e&scope.project.id=e60040c3d40b41448eaac9c9bb40dc84&role.id=9aea1c8bef3a4845b02455d1934a3771 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:18.176955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45032915-7e2f-4e6d-9687-3478f151daa4 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:18.177484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45032915-7e2f-4e6d-9687-3478f151daa4 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:18.177484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45032915-7e2f-4e6d-9687-3478f151daa4 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:18.179168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 524/1048] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:18.184300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a985-ef5f-4234-a2af-e9ede7d5c481 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:18.184685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a985-ef5f-4234-a2af-e9ede7d5c481 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:18.184879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a985-ef5f-4234-a2af-e9ede7d5c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:18.206942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-72f9a985-ef5f-4234-a2af-e9ede7d5c481 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:18.208069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-72f9a985-ef5f-4234-a2af-e9ede7d5c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:18.215737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 525/1049] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:18 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:44:18.238752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45032915-7e2f-4e6d-9687-3478f151daa4 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:18.250450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45032915-7e2f-4e6d-9687-3478f151daa4 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:18.254486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea621256-fbf0-4e7b-9d47-bc9cfc2faecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:18.255189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621256-fbf0-4e7b-9d47-bc9cfc2faecd admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:18.255474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621256-fbf0-4e7b-9d47-bc9cfc2faecd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:18.255748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621256-fbf0-4e7b-9d47-bc9cfc2faecd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:18.256826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea621256-fbf0-4e7b-9d47-bc9cfc2faecd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:18.258998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea621256-fbf0-4e7b-9d47-bc9cfc2faecd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:18.260426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 525/1050] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:44:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:18.266067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a985-ef5f-4234-a2af-e9ede7d5c481 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:18.275263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a985-ef5f-4234-a2af-e9ede7d5c481 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:18.279517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73151a7d-deb8-4f07-aa2b-b3bf17537a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:18.280098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73151a7d-deb8-4f07-aa2b-b3bf17537a48 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:18.280389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73151a7d-deb8-4f07-aa2b-b3bf17537a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:18.280672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73151a7d-deb8-4f07-aa2b-b3bf17537a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:18.281315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73151a7d-deb8-4f07-aa2b-b3bf17537a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:18.283227 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73151a7d-deb8-4f07-aa2b-b3bf17537a48 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:18.309027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 526/1051] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:44:18 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:44:20.427082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc412-ba97-4d7e-9e79-d64afbc034e0 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:20.427715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc412-ba97-4d7e-9e79-d64afbc034e0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:20.427715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc412-ba97-4d7e-9e79-d64afbc034e0 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:20.429301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 526/1052] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:20.434983 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566248d4-97fa-4fe0-9bbc-2f9e46bd586c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:20.435406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566248d4-97fa-4fe0-9bbc-2f9e46bd586c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:20.435537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566248d4-97fa-4fe0-9bbc-2f9e46bd586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:20.456724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-566248d4-97fa-4fe0-9bbc-2f9e46bd586c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:20.457842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-566248d4-97fa-4fe0-9bbc-2f9e46bd586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:20.520932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 527/1053] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:20 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:20.545197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc412-ba97-4d7e-9e79-d64afbc034e0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:20.557625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc412-ba97-4d7e-9e79-d64afbc034e0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:20.561746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5680b-0965-44dc-ae0e-88c0eaf77205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:20.562488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5680b-0965-44dc-ae0e-88c0eaf77205 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:20.562780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5680b-0965-44dc-ae0e-88c0eaf77205 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:20.563059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5680b-0965-44dc-ae0e-88c0eaf77205 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:20.564141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5680b-0965-44dc-ae0e-88c0eaf77205 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:20.565804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5680b-0965-44dc-ae0e-88c0eaf77205 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:20.567286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 527/1054] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:44:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:20.573121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566248d4-97fa-4fe0-9bbc-2f9e46bd586c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:20.581932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566248d4-97fa-4fe0-9bbc-2f9e46bd586c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:20.586209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653c30e-a943-4d89-a580-4eeaa204181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:20.586841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653c30e-a943-4d89-a580-4eeaa204181f admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:20.587130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653c30e-a943-4d89-a580-4eeaa204181f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:20.587412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653c30e-a943-4d89-a580-4eeaa204181f admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:20.588074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653c30e-a943-4d89-a580-4eeaa204181f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:20.589983 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653c30e-a943-4d89-a580-4eeaa204181f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:20.610690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 528/1055] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:44:20 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:44:22.714277 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025071e-537e-484b-baf9-93a5ce23feff None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:22.714890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025071e-537e-484b-baf9-93a5ce23feff None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:22.714890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025071e-537e-484b-baf9-93a5ce23feff None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:22.716528 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 528/1056] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:22.721610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4598-2a34-469c-b50c-a3cd1fc336ee None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:22.722000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4598-2a34-469c-b50c-a3cd1fc336ee None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:22.722170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4598-2a34-469c-b50c-a3cd1fc336ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:22.743670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-033d4598-2a34-469c-b50c-a3cd1fc336ee None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:22.744795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-033d4598-2a34-469c-b50c-a3cd1fc336ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:22.751631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 529/1057] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:22.775090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025071e-537e-484b-baf9-93a5ce23feff None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:22.786784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025071e-537e-484b-baf9-93a5ce23feff None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:22.790836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20144d-989a-4a4d-8f62-53e1eeb20a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:22.791546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20144d-989a-4a4d-8f62-53e1eeb20a0d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:22.791833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20144d-989a-4a4d-8f62-53e1eeb20a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:22.792112 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20144d-989a-4a4d-8f62-53e1eeb20a0d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:22.803507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20144d-989a-4a4d-8f62-53e1eeb20a0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:22.810038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-4b20144d-989a-4a4d-8f62-53e1eeb20a0d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:22.811212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 529/1058] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:22.817445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d4598-2a34-469c-b50c-a3cd1fc336ee None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:22.826718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d4598-2a34-469c-b50c-a3cd1fc336ee None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:22.830943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:22.831535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:22.831825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:22.832103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:22.832812 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:22.833112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:22.834723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:22.843764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 530/1059] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:22.849452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20144d-989a-4a4d-8f62-53e1eeb20a0d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:22.858948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20144d-989a-4a4d-8f62-53e1eeb20a0d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:22.863327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928405b-0644-4b81-a3e0-cbeef6e75e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:22.864108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928405b-0644-4b81-a3e0-cbeef6e75e65 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:22.864390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928405b-0644-4b81-a3e0-cbeef6e75e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:22.864665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928405b-0644-4b81-a3e0-cbeef6e75e65 admin admin] PATH_INFO: `/v3/users/6a27ca5f05914b5c8e2c141aac84f63f` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:22.882987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928405b-0644-4b81-a3e0-cbeef6e75e65 admin admin] RBAC: Authorizing `identity:get_user(user_id=6a27ca5f05914b5c8e2c141aac84f63f)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:22.885123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928405b-0644-4b81-a3e0-cbeef6e75e65 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:22.886660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 530/1060] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:22 2021] GET /identity/v3/users/6a27ca5f05914b5c8e2c141aac84f63f => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:22.892472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:22.902497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546affb-d1c9-468d-aa36-33a26a706b74 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:22.906712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decd41d-f14c-4740-abb3-33868e753158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:22.907286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd41d-f14c-4740-abb3-33868e753158 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:22.907575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd41d-f14c-4740-abb3-33868e753158 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:22.907855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd41d-f14c-4740-abb3-33868e753158 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:22.915558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decd41d-f14c-4740-abb3-33868e753158 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:22.917304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decd41d-f14c-4740-abb3-33868e753158 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:22.926742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 531/1061] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:22 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:44:22.933043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928405b-0644-4b81-a3e0-cbeef6e75e65 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:22.943075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928405b-0644-4b81-a3e0-cbeef6e75e65 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:22.947997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ed617-fa12-4291-82d6-59323a44c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:22.948809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ed617-fa12-4291-82d6-59323a44c650 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:22.949092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ed617-fa12-4291-82d6-59323a44c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:22.949370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ed617-fa12-4291-82d6-59323a44c650 admin admin] PATH_INFO: `/v3/projects/d0feee55b86c461dadc08b5ae307d3b5` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:22.950862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ed617-fa12-4291-82d6-59323a44c650 admin admin] RBAC: Authorizing `identity:get_project(project_id=d0feee55b86c461dadc08b5ae307d3b5)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:22.952923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ed617-fa12-4291-82d6-59323a44c650 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:22.954616 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 531/1062] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:22 2021] GET /identity/v3/projects/d0feee55b86c461dadc08b5ae307d3b5 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:22.961549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decd41d-f14c-4740-abb3-33868e753158 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:22.970363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decd41d-f14c-4740-abb3-33868e753158 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:22.974672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9ad1f-b025-4407-84ed-0f3c93a416c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:22.975260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ad1f-b025-4407-84ed-0f3c93a416c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:22.975570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ad1f-b025-4407-84ed-0f3c93a416c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:22.975852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ad1f-b025-4407-84ed-0f3c93a416c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:22.976628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9ad1f-b025-4407-84ed-0f3c93a416c9 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=d0feee55b86c461dadc08b5ae307d3b5, user.id=6a27ca5f05914b5c8e2c141aac84f63f) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:22.976933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9ad1f-b025-4407-84ed-0f3c93a416c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:22.978799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9ad1f-b025-4407-84ed-0f3c93a416c9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:22.984540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 532/1063] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:44:22 2021] GET /identity/v3/role_assignments?user.id=6a27ca5f05914b5c8e2c141aac84f63f&scope.project.id=d0feee55b86c461dadc08b5ae307d3b5&role.id=98f77a1006404111a8be8686551c8675 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:25.068485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe63c-9ea6-4c8a-b4f4-800ac94b7146 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:25.069008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe63c-9ea6-4c8a-b4f4-800ac94b7146 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:25.069121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe63c-9ea6-4c8a-b4f4-800ac94b7146 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:25.070724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 532/1064] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:25.076121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7a07-65f7-4ea4-8536-15cacb9a98bb None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:25.076539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7a07-65f7-4ea4-8536-15cacb9a98bb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:25.076638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7a07-65f7-4ea4-8536-15cacb9a98bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:25.102695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-de2d7a07-65f7-4ea4-8536-15cacb9a98bb None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:25.103843 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-de2d7a07-65f7-4ea4-8536-15cacb9a98bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:25.111138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 533/1065] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:25 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:25.140226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fe63c-9ea6-4c8a-b4f4-800ac94b7146 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:25.151882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fe63c-9ea6-4c8a-b4f4-800ac94b7146 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:25.155884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45ae9b-7582-49e7-b82b-a1b5256805f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:25.156585 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45ae9b-7582-49e7-b82b-a1b5256805f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:25.156867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45ae9b-7582-49e7-b82b-a1b5256805f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:25.157141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45ae9b-7582-49e7-b82b-a1b5256805f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:25.168468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45ae9b-7582-49e7-b82b-a1b5256805f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:25.174998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-af45ae9b-7582-49e7-b82b-a1b5256805f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:25.176102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 533/1066] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:25.182783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d7a07-65f7-4ea4-8536-15cacb9a98bb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:25.191405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d7a07-65f7-4ea4-8536-15cacb9a98bb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:25.195724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:25.196316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:25.196606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:25.196889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:25.197597 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:25.197897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:25.199519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:25.208021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 534/1067] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:25.213722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45ae9b-7582-49e7-b82b-a1b5256805f5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:25.223337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45ae9b-7582-49e7-b82b-a1b5256805f5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:25.228007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22647834-2333-487b-a469-36cfa92e931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:25.228778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647834-2333-487b-a469-36cfa92e931a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:25.229060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647834-2333-487b-a469-36cfa92e931a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:25.229339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647834-2333-487b-a469-36cfa92e931a admin admin] PATH_INFO: `/v3/users/6a27ca5f05914b5c8e2c141aac84f63f` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:25.230455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22647834-2333-487b-a469-36cfa92e931a admin admin] RBAC: Authorizing `identity:get_user(user_id=6a27ca5f05914b5c8e2c141aac84f63f)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:25.232537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22647834-2333-487b-a469-36cfa92e931a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:25.234234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 534/1068] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:25 2021] GET /identity/v3/users/6a27ca5f05914b5c8e2c141aac84f63f => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:25.239936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:25.249872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ebc1e-b288-42e2-8d53-fbfdfbb755c5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:25.254079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528630c-5143-4122-b737-0e6be797055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:25.254887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528630c-5143-4122-b737-0e6be797055f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:25.255178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528630c-5143-4122-b737-0e6be797055f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:25.255464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528630c-5143-4122-b737-0e6be797055f admin admin] PATH_INFO: `/v3/projects/d0feee55b86c461dadc08b5ae307d3b5` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:25.256554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528630c-5143-4122-b737-0e6be797055f admin admin] RBAC: Authorizing `identity:get_project(project_id=d0feee55b86c461dadc08b5ae307d3b5)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:25.258661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528630c-5143-4122-b737-0e6be797055f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:25.260257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 535/1069] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:25 2021] GET /identity/v3/projects/d0feee55b86c461dadc08b5ae307d3b5 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:25.266652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22647834-2333-487b-a469-36cfa92e931a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:25.277050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22647834-2333-487b-a469-36cfa92e931a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:25.281512 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611cbe0-cbdb-4381-a530-dd6d1a666a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:25.282351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611cbe0-cbdb-4381-a530-dd6d1a666a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:25.282662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611cbe0-cbdb-4381-a530-dd6d1a666a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:25.282941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611cbe0-cbdb-4381-a530-dd6d1a666a48 admin admin] PATH_INFO: `/v3/projects/d0feee55b86c461dadc08b5ae307d3b5/users/6a27ca5f05914b5c8e2c141aac84f63f/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:25.284927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611cbe0-cbdb-4381-a530-dd6d1a666a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0feee55b86c461dadc08b5ae307d3b5, user_id=6a27ca5f05914b5c8e2c141aac84f63f, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:25.287592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611cbe0-cbdb-4381-a530-dd6d1a666a48 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:25.301829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 535/1070] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:44:25 2021] PUT /identity/v3/projects/d0feee55b86c461dadc08b5ae307d3b5/users/6a27ca5f05914b5c8e2c141aac84f63f/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:44:27.382873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f71d9-dace-4acd-a8bf-8f92094665b9 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:27.383435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f71d9-dace-4acd-a8bf-8f92094665b9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:27.383435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f71d9-dace-4acd-a8bf-8f92094665b9 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:27.385088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 536/1071] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:27.390313 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cf1f4-2650-49e4-a1c0-9307f8db6fb1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:27.390751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cf1f4-2650-49e4-a1c0-9307f8db6fb1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:27.390907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cf1f4-2650-49e4-a1c0-9307f8db6fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:27.412962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-aa9cf1f4-2650-49e4-a1c0-9307f8db6fb1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:27.414094 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-aa9cf1f4-2650-49e4-a1c0-9307f8db6fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:27.476689 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 536/1072] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:27 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:44:27.500416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f71d9-dace-4acd-a8bf-8f92094665b9 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:27.512632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f71d9-dace-4acd-a8bf-8f92094665b9 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:27.516610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdd0eb-d405-4776-9b65-f47429776851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:27.517315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd0eb-d405-4776-9b65-f47429776851 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:27.517596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd0eb-d405-4776-9b65-f47429776851 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:27.517869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd0eb-d405-4776-9b65-f47429776851 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:27.529304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdd0eb-d405-4776-9b65-f47429776851 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:27.535721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-bdbdd0eb-d405-4776-9b65-f47429776851 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:27.536813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 537/1073] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:27.543149 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cf1f4-2650-49e4-a1c0-9307f8db6fb1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:27.551746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cf1f4-2650-49e4-a1c0-9307f8db6fb1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:27.556472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:27.557067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:27.557353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:27.557630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:27.558350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:27.558681 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:27.560292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:27.570483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 537/1074] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:27.576602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdd0eb-d405-4776-9b65-f47429776851 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:27.586491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdd0eb-d405-4776-9b65-f47429776851 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:27.590888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ac1e3-9e7b-4eed-82bd-c5ae26e18a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:27.591693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac1e3-9e7b-4eed-82bd-c5ae26e18a9f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:27.591974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac1e3-9e7b-4eed-82bd-c5ae26e18a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:27.592248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac1e3-9e7b-4eed-82bd-c5ae26e18a9f admin admin] PATH_INFO: `/v3/users/6a27ca5f05914b5c8e2c141aac84f63f` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:27.593360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ac1e3-9e7b-4eed-82bd-c5ae26e18a9f admin admin] RBAC: Authorizing `identity:get_user(user_id=6a27ca5f05914b5c8e2c141aac84f63f)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:27.595525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ac1e3-9e7b-4eed-82bd-c5ae26e18a9f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:27.597034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 538/1075] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:27 2021] GET /identity/v3/users/6a27ca5f05914b5c8e2c141aac84f63f => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:27.603020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:27.612790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303722e-39c9-4660-90f3-0668b30139fc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:27.617549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e438734-7093-4f2c-a28f-5fc243690ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:27.618111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e438734-7093-4f2c-a28f-5fc243690ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:27.618393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e438734-7093-4f2c-a28f-5fc243690ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:27.618696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e438734-7093-4f2c-a28f-5fc243690ba1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:27.626513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e438734-7093-4f2c-a28f-5fc243690ba1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:27.628230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e438734-7093-4f2c-a28f-5fc243690ba1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:27.637274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 538/1076] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:27 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:44:27.643394 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ac1e3-9e7b-4eed-82bd-c5ae26e18a9f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:27.652649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ac1e3-9e7b-4eed-82bd-c5ae26e18a9f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:27.656792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd804187-4e57-4d2c-a960-d3405172af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:27.657556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804187-4e57-4d2c-a960-d3405172af1e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:27.657836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804187-4e57-4d2c-a960-d3405172af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:27.658110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804187-4e57-4d2c-a960-d3405172af1e admin admin] PATH_INFO: `/v3/projects/d0feee55b86c461dadc08b5ae307d3b5` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:27.659292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd804187-4e57-4d2c-a960-d3405172af1e admin admin] RBAC: Authorizing `identity:get_project(project_id=d0feee55b86c461dadc08b5ae307d3b5)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:27.661368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd804187-4e57-4d2c-a960-d3405172af1e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:27.662940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 539/1077] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:27 2021] GET /identity/v3/projects/d0feee55b86c461dadc08b5ae307d3b5 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:44:27.668970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e438734-7093-4f2c-a28f-5fc243690ba1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:27.678147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e438734-7093-4f2c-a28f-5fc243690ba1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:27.683313 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5a10-a4e1-492c-ad53-cba49f182001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:27.683878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5a10-a4e1-492c-ad53-cba49f182001 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:27.684439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5a10-a4e1-492c-ad53-cba49f182001 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:27.684439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5a10-a4e1-492c-ad53-cba49f182001 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:27.685199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf5a10-a4e1-492c-ad53-cba49f182001 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=d0feee55b86c461dadc08b5ae307d3b5, user.id=6a27ca5f05914b5c8e2c141aac84f63f) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:27.685494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf5a10-a4e1-492c-ad53-cba49f182001 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:27.687328 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf5a10-a4e1-492c-ad53-cba49f182001 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:27.693022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 539/1078] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:44:27 2021] GET /identity/v3/role_assignments?user.id=6a27ca5f05914b5c8e2c141aac84f63f&scope.project.id=d0feee55b86c461dadc08b5ae307d3b5&role.id=98f77a1006404111a8be8686551c8675 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:29.801796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b1c23-ac39-4d2d-93a8-9d3f81a92049 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:29.802348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b1c23-ac39-4d2d-93a8-9d3f81a92049 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:29.802348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b1c23-ac39-4d2d-93a8-9d3f81a92049 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:29.804058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 540/1079] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:29.809479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b23c0-05b1-46e1-b0aa-fd3e82bd7a7b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:29.809877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b23c0-05b1-46e1-b0aa-fd3e82bd7a7b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:29.810179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b23c0-05b1-46e1-b0aa-fd3e82bd7a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:29.831970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ff5b23c0-05b1-46e1-b0aa-fd3e82bd7a7b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:29.833115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ff5b23c0-05b1-46e1-b0aa-fd3e82bd7a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:29.840655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 540/1080] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:29 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:29.862976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b1c23-ac39-4d2d-93a8-9d3f81a92049 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:29.874697 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b1c23-ac39-4d2d-93a8-9d3f81a92049 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:29.878753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4be2c2-30af-4fd1-bb4a-793866db6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:29.879319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4be2c2-30af-4fd1-bb4a-793866db6b2b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:29.879606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4be2c2-30af-4fd1-bb4a-793866db6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:29.879887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4be2c2-30af-4fd1-bb4a-793866db6b2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:29.887521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4be2c2-30af-4fd1-bb4a-793866db6b2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:29.889250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4be2c2-30af-4fd1-bb4a-793866db6b2b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:29.898201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 541/1081] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:29 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:44:29.904093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b23c0-05b1-46e1-b0aa-fd3e82bd7a7b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:29.912694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b23c0-05b1-46e1-b0aa-fd3e82bd7a7b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:29.917016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10758ebf-091f-4afc-b367-49695483f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:29.918222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10758ebf-091f-4afc-b367-49695483f7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:29.918540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10758ebf-091f-4afc-b367-49695483f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:29.918820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10758ebf-091f-4afc-b367-49695483f7c1 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:29.926844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10758ebf-091f-4afc-b367-49695483f7c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:29.928683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10758ebf-091f-4afc-b367-49695483f7c1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:29.943511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-10758ebf-091f-4afc-b367-49695483f7c1 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 25 14:44:29.944627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 541/1082] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:44:29 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:29.950988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4be2c2-30af-4fd1-bb4a-793866db6b2b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:29.960280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4be2c2-30af-4fd1-bb4a-793866db6b2b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:29.964650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09875a-6a86-45d7-bd6b-a01ba636f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:29.965251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09875a-6a86-45d7-bd6b-a01ba636f174 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:29.965543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09875a-6a86-45d7-bd6b-a01ba636f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:29.965825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09875a-6a86-45d7-bd6b-a01ba636f174 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:29.966561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09875a-6a86-45d7-bd6b-a01ba636f174 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:29.966869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09875a-6a86-45d7-bd6b-a01ba636f174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:29.968498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09875a-6a86-45d7-bd6b-a01ba636f174 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:29.977909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 542/1083] 10.222.0.57 () {56 vars in 1136 bytes} [Mon Oct 25 14:44:29 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:32.029941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21c6a-4aee-4fad-92d2-d23bc0c58330 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:32.030490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21c6a-4aee-4fad-92d2-d23bc0c58330 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:32.030582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21c6a-4aee-4fad-92d2-d23bc0c58330 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:32.032224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 542/1084] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:32.037401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8a76-824a-4dc3-8ee1-2a02a7a1a7a0 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:32.037808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8a76-824a-4dc3-8ee1-2a02a7a1a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:32.037993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8a76-824a-4dc3-8ee1-2a02a7a1a7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:32.059773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b37a8a76-824a-4dc3-8ee1-2a02a7a1a7a0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:32.060964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b37a8a76-824a-4dc3-8ee1-2a02a7a1a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:32.067917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 543/1085] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:32 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:32.090819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece21c6a-4aee-4fad-92d2-d23bc0c58330 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:32.102556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece21c6a-4aee-4fad-92d2-d23bc0c58330 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:32.106672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a60b98-67a7-4c6a-b11c-1e8c372d4328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:32.107248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60b98-67a7-4c6a-b11c-1e8c372d4328 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:32.107537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60b98-67a7-4c6a-b11c-1e8c372d4328 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:32.108070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60b98-67a7-4c6a-b11c-1e8c372d4328 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:32.108764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a60b98-67a7-4c6a-b11c-1e8c372d4328 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:32.109757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-49a60b98-67a7-4c6a-b11c-1e8c372d4328 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:44:32.109757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:44:32.109757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:44:32.110655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a60b98-67a7-4c6a-b11c-1e8c372d4328 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:32.125030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 543/1086] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Oct 25 14:44:32 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:44:34.256905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878c22-2771-4462-82b7-f1ec3948ca7a None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:34.257413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878c22-2771-4462-82b7-f1ec3948ca7a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:34.257413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878c22-2771-4462-82b7-f1ec3948ca7a None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:34.259163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 544/1087] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:34.264176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b919ef8-a136-46f3-bf90-eeb1789e9392 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:34.264577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b919ef8-a136-46f3-bf90-eeb1789e9392 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:34.264736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b919ef8-a136-46f3-bf90-eeb1789e9392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:34.286625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7b919ef8-a136-46f3-bf90-eeb1789e9392 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:34.288302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7b919ef8-a136-46f3-bf90-eeb1789e9392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:34.352999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 544/1088] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:34 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:34.376177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878c22-2771-4462-82b7-f1ec3948ca7a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:34.388053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878c22-2771-4462-82b7-f1ec3948ca7a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:34.392139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092baa47-ddbe-4158-b47f-c4b476bcadf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:34.392928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092baa47-ddbe-4158-b47f-c4b476bcadf4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:34.393213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092baa47-ddbe-4158-b47f-c4b476bcadf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:34.393494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092baa47-ddbe-4158-b47f-c4b476bcadf4 admin admin] PATH_INFO: `/v3/domains/591e4ad6ab5e435fa77bc01457695cec` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:34.405769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092baa47-ddbe-4158-b47f-c4b476bcadf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=591e4ad6ab5e435fa77bc01457695cec)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:34.407748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092baa47-ddbe-4158-b47f-c4b476bcadf4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:34.409367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 545/1089] 10.222.0.57 () {56 vars in 1204 bytes} [Mon Oct 25 14:44:34 2021] GET /identity/v3/domains/591e4ad6ab5e435fa77bc01457695cec => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:34.416932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b919ef8-a136-46f3-bf90-eeb1789e9392 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:34.427058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b919ef8-a136-46f3-bf90-eeb1789e9392 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:34.431475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da97db5-f1af-4c4a-b170-67b9ec5c5e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:34.432079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da97db5-f1af-4c4a-b170-67b9ec5c5e18 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:34.432366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da97db5-f1af-4c4a-b170-67b9ec5c5e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:34.432641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da97db5-f1af-4c4a-b170-67b9ec5c5e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:34.433320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da97db5-f1af-4c4a-b170-67b9ec5c5e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:34.435309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da97db5-f1af-4c4a-b170-67b9ec5c5e18 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:34.463857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 545/1090] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:44:34 2021] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:44:36.572015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb4624-e77a-4680-b8e6-9e8db2f3eb16 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:36.572546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb4624-e77a-4680-b8e6-9e8db2f3eb16 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:36.572637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb4624-e77a-4680-b8e6-9e8db2f3eb16 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:36.574266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 546/1091] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:36.579407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9def50-2456-4948-ae26-939a64e70c95 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:36.579811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9def50-2456-4948-ae26-939a64e70c95 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:36.579974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9def50-2456-4948-ae26-939a64e70c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:36.601293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0a9def50-2456-4948-ae26-939a64e70c95 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:36.602443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0a9def50-2456-4948-ae26-939a64e70c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:36.664319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 546/1092] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:36 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:36.688330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb4624-e77a-4680-b8e6-9e8db2f3eb16 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:36.700780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb4624-e77a-4680-b8e6-9e8db2f3eb16 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:36.704883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047895df-bcb9-4728-87d4-7058b661429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:36.705665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047895df-bcb9-4728-87d4-7058b661429d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:36.705956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047895df-bcb9-4728-87d4-7058b661429d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:36.706242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047895df-bcb9-4728-87d4-7058b661429d admin admin] PATH_INFO: `/v3/domains/591e4ad6ab5e435fa77bc01457695cec` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:36.707365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047895df-bcb9-4728-87d4-7058b661429d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=591e4ad6ab5e435fa77bc01457695cec)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:36.709295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047895df-bcb9-4728-87d4-7058b661429d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:36.710800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 547/1093] 10.222.0.57 () {56 vars in 1204 bytes} [Mon Oct 25 14:44:36 2021] GET /identity/v3/domains/591e4ad6ab5e435fa77bc01457695cec => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:36.716552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9def50-2456-4948-ae26-939a64e70c95 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:36.725195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9def50-2456-4948-ae26-939a64e70c95 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:36.729405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501040a8-80ee-4fdd-8c77-f41365569a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:36.729992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501040a8-80ee-4fdd-8c77-f41365569a85 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:36.730280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501040a8-80ee-4fdd-8c77-f41365569a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:36.730596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501040a8-80ee-4fdd-8c77-f41365569a85 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:36.731255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501040a8-80ee-4fdd-8c77-f41365569a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:36.733407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501040a8-80ee-4fdd-8c77-f41365569a85 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:36.754079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 547/1094] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:44:36 2021] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:44:38.884566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bb697-942b-45e4-af41-55862c071659 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:38.885086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bb697-942b-45e4-af41-55862c071659 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:38.885175 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bb697-942b-45e4-af41-55862c071659 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:38.886836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 548/1095] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:38.891911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967dfa-ca24-4307-a353-d163015a048e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:38.892353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967dfa-ca24-4307-a353-d163015a048e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:38.892468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967dfa-ca24-4307-a353-d163015a048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:38.914855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-48967dfa-ca24-4307-a353-d163015a048e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:38.915984 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-48967dfa-ca24-4307-a353-d163015a048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:38.922935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 548/1096] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:38 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:44:38.946722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bb697-942b-45e4-af41-55862c071659 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:38.958623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bb697-942b-45e4-af41-55862c071659 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:38.962715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a27cad-ad44-4b41-af2b-8995f641a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:38.963430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27cad-ad44-4b41-af2b-8995f641a3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:38.963719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27cad-ad44-4b41-af2b-8995f641a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:38.963998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27cad-ad44-4b41-af2b-8995f641a3f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:38.975191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a27cad-ad44-4b41-af2b-8995f641a3f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:38.981628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-b6a27cad-ad44-4b41-af2b-8995f641a3f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:38.983024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 549/1097] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:38.989208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48967dfa-ca24-4307-a353-d163015a048e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:38.998317 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48967dfa-ca24-4307-a353-d163015a048e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:39.002610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:39.003189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:39.003471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:39.003748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:39.004452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:39.004746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:39.006973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:39.015349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 549/1098] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:39.021123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a27cad-ad44-4b41-af2b-8995f641a3f4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:39.030931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a27cad-ad44-4b41-af2b-8995f641a3f4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:39.035388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776c7cd-e0c7-4ef4-8c1a-ce250b3fdc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:39.036176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c7cd-e0c7-4ef4-8c1a-ce250b3fdc8f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:39.036467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c7cd-e0c7-4ef4-8c1a-ce250b3fdc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:39.036749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c7cd-e0c7-4ef4-8c1a-ce250b3fdc8f admin admin] PATH_INFO: `/v3/users/3d7b2befa93e4afc9e18e4210e9269d7` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:39.055297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776c7cd-e0c7-4ef4-8c1a-ce250b3fdc8f admin admin] RBAC: Authorizing `identity:get_user(user_id=3d7b2befa93e4afc9e18e4210e9269d7)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:39.057434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776c7cd-e0c7-4ef4-8c1a-ce250b3fdc8f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:39.059037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 550/1099] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:39 2021] GET /identity/v3/users/3d7b2befa93e4afc9e18e4210e9269d7 => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:39.064912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:39.075488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f8909-9bc8-4a87-b4fa-600e1a98a630 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:39.079864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba314e-abf9-4cf7-8200-4ee165627526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:39.080458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba314e-abf9-4cf7-8200-4ee165627526 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:39.080744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba314e-abf9-4cf7-8200-4ee165627526 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:39.081022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba314e-abf9-4cf7-8200-4ee165627526 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:39.089792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba314e-abf9-4cf7-8200-4ee165627526 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:39.091596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba314e-abf9-4cf7-8200-4ee165627526 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:39.101203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 550/1100] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:39 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:44:39.107359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776c7cd-e0c7-4ef4-8c1a-ce250b3fdc8f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:39.117581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776c7cd-e0c7-4ef4-8c1a-ce250b3fdc8f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:39.121947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e0ce-8686-4f38-ac6f-31d226c8e879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:39.122783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e0ce-8686-4f38-ac6f-31d226c8e879 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:39.123069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e0ce-8686-4f38-ac6f-31d226c8e879 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:39.123351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e0ce-8686-4f38-ac6f-31d226c8e879 admin admin] PATH_INFO: `/v3/projects/989a347eacd0420687609d722541402c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:39.124443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9e0ce-8686-4f38-ac6f-31d226c8e879 admin admin] RBAC: Authorizing `identity:get_project(project_id=989a347eacd0420687609d722541402c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:39.126504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9e0ce-8686-4f38-ac6f-31d226c8e879 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:39.128057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 551/1101] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:39 2021] GET /identity/v3/projects/989a347eacd0420687609d722541402c => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:39.134983 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba314e-abf9-4cf7-8200-4ee165627526 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:39.143592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba314e-abf9-4cf7-8200-4ee165627526 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:39.147884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0b65f-15b1-4d95-b0b2-5be4f7f5dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:39.148449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0b65f-15b1-4d95-b0b2-5be4f7f5dcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:39.148731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0b65f-15b1-4d95-b0b2-5be4f7f5dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:39.149009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0b65f-15b1-4d95-b0b2-5be4f7f5dcf1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:39.149776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0b65f-15b1-4d95-b0b2-5be4f7f5dcf1 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=989a347eacd0420687609d722541402c, user.id=3d7b2befa93e4afc9e18e4210e9269d7) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:39.150075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0b65f-15b1-4d95-b0b2-5be4f7f5dcf1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:39.151912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0b65f-15b1-4d95-b0b2-5be4f7f5dcf1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:39.157274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 551/1102] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:44:39 2021] GET /identity/v3/role_assignments?user.id=3d7b2befa93e4afc9e18e4210e9269d7&scope.project.id=989a347eacd0420687609d722541402c&role.id=98f77a1006404111a8be8686551c8675 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:41.269215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c88d-1837-41a6-8c02-f85bb104db83 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:41.269734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c88d-1837-41a6-8c02-f85bb104db83 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:41.269734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c88d-1837-41a6-8c02-f85bb104db83 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:41.271510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 552/1103] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:41.277008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85221c-b41d-4de1-8ee4-51e11a4854bb None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:41.277430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85221c-b41d-4de1-8ee4-51e11a4854bb None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:41.277571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85221c-b41d-4de1-8ee4-51e11a4854bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:41.299684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-dd85221c-b41d-4de1-8ee4-51e11a4854bb None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:41.300812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-dd85221c-b41d-4de1-8ee4-51e11a4854bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:41.307756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 552/1104] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:41 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:44:41.329596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c88d-1837-41a6-8c02-f85bb104db83 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:41.343305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c88d-1837-41a6-8c02-f85bb104db83 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:41.347343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223173e-d86c-4c4a-b58e-f58225ffcc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:41.348051 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223173e-d86c-4c4a-b58e-f58225ffcc86 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:41.348333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223173e-d86c-4c4a-b58e-f58225ffcc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:41.348606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223173e-d86c-4c4a-b58e-f58225ffcc86 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:41.360210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223173e-d86c-4c4a-b58e-f58225ffcc86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:41.366616 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-7223173e-d86c-4c4a-b58e-f58225ffcc86 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:41.367709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 553/1105] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:44:41.373787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85221c-b41d-4de1-8ee4-51e11a4854bb None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:41.382845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85221c-b41d-4de1-8ee4-51e11a4854bb None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:41.387201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:41.387782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:41.388066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:41.388342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:41.389051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:41.389345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:41.390946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:41.399854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 553/1106] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:41.405582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223173e-d86c-4c4a-b58e-f58225ffcc86 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:41.415305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223173e-d86c-4c4a-b58e-f58225ffcc86 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:41.419476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6593727-fa65-4e04-be26-984e17886031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:41.420250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6593727-fa65-4e04-be26-984e17886031 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:41.420534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6593727-fa65-4e04-be26-984e17886031 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:41.420812 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6593727-fa65-4e04-be26-984e17886031 admin admin] PATH_INFO: `/v3/users/3d7b2befa93e4afc9e18e4210e9269d7` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:41.421884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6593727-fa65-4e04-be26-984e17886031 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d7b2befa93e4afc9e18e4210e9269d7)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:41.423995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6593727-fa65-4e04-be26-984e17886031 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:41.425432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 554/1107] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:41 2021] GET /identity/v3/users/3d7b2befa93e4afc9e18e4210e9269d7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:41.431405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:41.441337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23230663-d1d1-4542-ba67-92f3c07327ff admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:41.446577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b2986-31d8-4253-8a8d-bf9cd5383b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:41.447390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2986-31d8-4253-8a8d-bf9cd5383b14 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:41.447680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2986-31d8-4253-8a8d-bf9cd5383b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:41.447958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2986-31d8-4253-8a8d-bf9cd5383b14 admin admin] PATH_INFO: `/v3/projects/989a347eacd0420687609d722541402c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:41.449106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b2986-31d8-4253-8a8d-bf9cd5383b14 admin admin] RBAC: Authorizing `identity:get_project(project_id=989a347eacd0420687609d722541402c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:41.451234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b2986-31d8-4253-8a8d-bf9cd5383b14 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:41.452920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 554/1108] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:41 2021] GET /identity/v3/projects/989a347eacd0420687609d722541402c => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:41.459326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6593727-fa65-4e04-be26-984e17886031 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:41.469625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6593727-fa65-4e04-be26-984e17886031 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:41.474002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1757d-7e5b-4cb2-bc3e-4316e91560e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:41.474857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1757d-7e5b-4cb2-bc3e-4316e91560e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:41.475149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1757d-7e5b-4cb2-bc3e-4316e91560e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:41.475430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1757d-7e5b-4cb2-bc3e-4316e91560e6 admin admin] PATH_INFO: `/v3/projects/989a347eacd0420687609d722541402c/users/3d7b2befa93e4afc9e18e4210e9269d7/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:41.477221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1757d-7e5b-4cb2-bc3e-4316e91560e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989a347eacd0420687609d722541402c, user_id=3d7b2befa93e4afc9e18e4210e9269d7, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:41.479896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1757d-7e5b-4cb2-bc3e-4316e91560e6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:41.494312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 555/1109] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:44:41 2021] PUT /identity/v3/projects/989a347eacd0420687609d722541402c/users/3d7b2befa93e4afc9e18e4210e9269d7/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:44:43.587767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8b3da-7ae8-41e9-bf2d-8d86d521d490 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:43.588329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8b3da-7ae8-41e9-bf2d-8d86d521d490 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:43.588329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8b3da-7ae8-41e9-bf2d-8d86d521d490 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:43.589984 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 555/1110] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:44:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:44:43.595184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84106979-7550-4502-b52e-a0bb86aa4316 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:43.595574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84106979-7550-4502-b52e-a0bb86aa4316 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:43.595738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84106979-7550-4502-b52e-a0bb86aa4316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:43.617827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-84106979-7550-4502-b52e-a0bb86aa4316 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:44:43.618976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-84106979-7550-4502-b52e-a0bb86aa4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:44:43.681046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 556/1111] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:44:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:44:43.704116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8b3da-7ae8-41e9-bf2d-8d86d521d490 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:43.715812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8b3da-7ae8-41e9-bf2d-8d86d521d490 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:43.719860 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9777-463d-448e-af1b-c752b42e6821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:43.720566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9777-463d-448e-af1b-c752b42e6821 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:43.720851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9777-463d-448e-af1b-c752b42e6821 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:43.721126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9777-463d-448e-af1b-c752b42e6821 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:43.733066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf9777-463d-448e-af1b-c752b42e6821 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:44:43.739456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-d2cf9777-463d-448e-af1b-c752b42e6821 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:44:43.741181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 556/1112] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:44:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:44:43.747818 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84106979-7550-4502-b52e-a0bb86aa4316 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:43.757065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84106979-7550-4502-b52e-a0bb86aa4316 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:43.761516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:43.762141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:43.762459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:43.762746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:43.763486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:43.763788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:43.765423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:43.774871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 557/1113] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:44:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:43.781222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9777-463d-448e-af1b-c752b42e6821 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:43.791254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9777-463d-448e-af1b-c752b42e6821 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:43.795714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcad3-d596-43d0-9ce1-a3190d29f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:43.796821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcad3-d596-43d0-9ce1-a3190d29f1ff admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:43.797218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcad3-d596-43d0-9ce1-a3190d29f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:43.797499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcad3-d596-43d0-9ce1-a3190d29f1ff admin admin] PATH_INFO: `/v3/users/3d7b2befa93e4afc9e18e4210e9269d7` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:43.798632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addcad3-d596-43d0-9ce1-a3190d29f1ff admin admin] RBAC: Authorizing `identity:get_user(user_id=3d7b2befa93e4afc9e18e4210e9269d7)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:43.801159 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addcad3-d596-43d0-9ce1-a3190d29f1ff admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:43.803639 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 557/1114] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:44:43 2021] GET /identity/v3/users/3d7b2befa93e4afc9e18e4210e9269d7 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:43.809904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:43.819454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44b18-a913-4942-928b-72e217a80caf admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:43.823777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba30437-31d5-4a30-96f2-f852a0c993d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:43.824354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30437-31d5-4a30-96f2-f852a0c993d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:43.824642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30437-31d5-4a30-96f2-f852a0c993d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:43.824922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30437-31d5-4a30-96f2-f852a0c993d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:43.832906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba30437-31d5-4a30-96f2-f852a0c993d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:43.834715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba30437-31d5-4a30-96f2-f852a0c993d6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:43.843229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 558/1115] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:44:43 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:44:43.849271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcad3-d596-43d0-9ce1-a3190d29f1ff admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:43.859985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcad3-d596-43d0-9ce1-a3190d29f1ff admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:43.864251 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf846f4-c9a6-43ef-acd3-b36b2c107fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:43.865199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf846f4-c9a6-43ef-acd3-b36b2c107fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:43.866054 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf846f4-c9a6-43ef-acd3-b36b2c107fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:43.866334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf846f4-c9a6-43ef-acd3-b36b2c107fa7 admin admin] PATH_INFO: `/v3/projects/989a347eacd0420687609d722541402c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:43.867537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf846f4-c9a6-43ef-acd3-b36b2c107fa7 admin admin] RBAC: Authorizing `identity:get_project(project_id=989a347eacd0420687609d722541402c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:43.869463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf846f4-c9a6-43ef-acd3-b36b2c107fa7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:43.871037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 558/1116] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:44:43 2021] GET /identity/v3/projects/989a347eacd0420687609d722541402c => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:44:43.877264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba30437-31d5-4a30-96f2-f852a0c993d6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:44:43.886788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba30437-31d5-4a30-96f2-f852a0c993d6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:44:43.891252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011324f-8bb4-4615-a855-cdfd99ca52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:44:43.891837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011324f-8bb4-4615-a855-cdfd99ca52f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:44:43.892123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011324f-8bb4-4615-a855-cdfd99ca52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:44:43.892404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011324f-8bb4-4615-a855-cdfd99ca52f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:44:43.893174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011324f-8bb4-4615-a855-cdfd99ca52f5 admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=989a347eacd0420687609d722541402c, user.id=3d7b2befa93e4afc9e18e4210e9269d7) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:44:43.893477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011324f-8bb4-4615-a855-cdfd99ca52f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:44:43.895359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011324f-8bb4-4615-a855-cdfd99ca52f5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:44:43.901376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 559/1117] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:44:43 2021] GET /identity/v3/role_assignments?user.id=3d7b2befa93e4afc9e18e4210e9269d7&scope.project.id=989a347eacd0420687609d722541402c&role.id=98f77a1006404111a8be8686551c8675 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:21.852828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936949-5a82-4dda-ba41-19c67b4344e9 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:21.853398 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936949-5a82-4dda-ba41-19c67b4344e9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:21.853398 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936949-5a82-4dda-ba41-19c67b4344e9 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:21.855076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 559/1118] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:21.860671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7846-20b1-4bc8-bb65-336c884c69ab None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:21.861072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7846-20b1-4bc8-bb65-336c884c69ab None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:21.861231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7846-20b1-4bc8-bb65-336c884c69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:21.884539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-11fd7846-20b1-4bc8-bb65-336c884c69ab None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:21.885690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-11fd7846-20b1-4bc8-bb65-336c884c69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:21.892737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 560/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:21 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:21.917027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42936949-5a82-4dda-ba41-19c67b4344e9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:21.928842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42936949-5a82-4dda-ba41-19c67b4344e9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:21.933031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:21.933733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:21.934017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:21.934290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:21.946369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:21.948206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:21.965657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:21.966799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 560/1120] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:21.973162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd7846-20b1-4bc8-bb65-336c884c69ab None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:21.981875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd7846-20b1-4bc8-bb65-336c884c69ab None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:21.986286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fe15b-e790-4082-90a0-2be4c1e353fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:21.986898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe15b-e790-4082-90a0-2be4c1e353fc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:21.987182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe15b-e790-4082-90a0-2be4c1e353fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:21.987457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe15b-e790-4082-90a0-2be4c1e353fc admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:21.988138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fe15b-e790-4082-90a0-2be4c1e353fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:21.988438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fe15b-e790-4082-90a0-2be4c1e353fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:21.990010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fe15b-e790-4082-90a0-2be4c1e353fc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:22.001975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 561/1121] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:22.008287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:22.024560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c940-155d-459b-9822-18bffe596aa9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:22.031910 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd9f7b-e470-49a0-b773-c32cac469a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:22.032531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9f7b-e470-49a0-b773-c32cac469a91 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:22.032825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9f7b-e470-49a0-b773-c32cac469a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:22.033110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9f7b-e470-49a0-b773-c32cac469a91 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:22.033791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd9f7b-e470-49a0-b773-c32cac469a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:22.035805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd9f7b-e470-49a0-b773-c32cac469a91 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:22.056459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 561/1122] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 25 14:46:22 2021] POST /identity/v3/users => generated 251 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:46:24.255178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3897e74-198f-4359-8e12-f1e22101e965 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.255694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3897e74-198f-4359-8e12-f1e22101e965 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.255694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3897e74-198f-4359-8e12-f1e22101e965 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.257323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 562/1123] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:24.262810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e49e7-261d-4b2d-a235-97f57662d6fa None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.263199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e49e7-261d-4b2d-a235-97f57662d6fa None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.263369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e49e7-261d-4b2d-a235-97f57662d6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.284637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d93e49e7-261d-4b2d-a235-97f57662d6fa None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:24.285759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d93e49e7-261d-4b2d-a235-97f57662d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:24.293307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 562/1124] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:24.316223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3897e74-198f-4359-8e12-f1e22101e965 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.328587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3897e74-198f-4359-8e12-f1e22101e965 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.332684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cb57d-2c06-431f-ba0b-7995a5c491f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.333404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cb57d-2c06-431f-ba0b-7995a5c491f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.333691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cb57d-2c06-431f-ba0b-7995a5c491f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.333970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cb57d-2c06-431f-ba0b-7995a5c491f8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.346920 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cb57d-2c06-431f-ba0b-7995a5c491f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:46:24.353751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-1b9cb57d-2c06-431f-ba0b-7995a5c491f8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:46:24.355004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 563/1125] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:24.361727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e49e7-261d-4b2d-a235-97f57662d6fa None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.371385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e49e7-261d-4b2d-a235-97f57662d6fa None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.375687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.376286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.376570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.376846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.377566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:24.377862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.379486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.388840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 563/1126] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:24.394881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cb57d-2c06-431f-ba0b-7995a5c491f8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.404884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cb57d-2c06-431f-ba0b-7995a5c491f8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.409193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.409903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.410189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.410500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.421822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.423672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.443759 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:24.445472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 564/1127] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:24.451388 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.460999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec378e-981f-41eb-89ef-67a70f981796 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.468526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.469535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.470037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.470584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.471862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:24.472410 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.475551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.498387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 564/1128] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:24.504120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.514211 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e9d30-8148-4bb0-80ff-1d567ba440bb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.518421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.519158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.519444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.519723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.532603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.534634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.552754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 14:46:24.553897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 565/1129] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:24.560306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.570522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88579-8586-4e10-8798-8d04a52896e0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.574780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.575370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.575656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.575946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.576735 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:24.577040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.578907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.608693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 565/1130] 10.222.0.57 () {56 vars in 1164 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:46:24.614716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.624566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f44a7c-a4f9-42dd-a892-7a9f6c3060d6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.628814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d060c7-31a5-47a0-8890-e6531d33de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.629397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d060c7-31a5-47a0-8890-e6531d33de46 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.629670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d060c7-31a5-47a0-8890-e6531d33de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.629951 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d060c7-31a5-47a0-8890-e6531d33de46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.638603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d060c7-31a5-47a0-8890-e6531d33de46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.640340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d060c7-31a5-47a0-8890-e6531d33de46 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.649430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 566/1131] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:46:24.655526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.664927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8711009-76ab-4824-9a1f-9beecbd90c97 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.669430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.670156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.670479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.670821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.687974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.690863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.710634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:24.711872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 566/1132] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:46:24.717864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d060c7-31a5-47a0-8890-e6531d33de46 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.727112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d060c7-31a5-47a0-8890-e6531d33de46 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.733083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.733919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.734604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.735038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.735973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:24.736505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.738287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.754454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 567/1133] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:24.764062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.775870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c1057-4eb5-4aee-b0c8-3f8b876008ea admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.780871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.781601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.781888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.782163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.791699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.793635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.808166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:46:24.809306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 567/1134] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:24.815324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.826813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb412a-7fd2-4a3b-b315-bd776f84bb04 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.830944 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ae0d9-4de9-4d35-9476-d4eff5812170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.831611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ae0d9-4de9-4d35-9476-d4eff5812170 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.831897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ae0d9-4de9-4d35-9476-d4eff5812170 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.832180 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ae0d9-4de9-4d35-9476-d4eff5812170 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.832982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ae0d9-4de9-4d35-9476-d4eff5812170 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:24.833268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ae0d9-4de9-4d35-9476-d4eff5812170 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.835187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ae0d9-4de9-4d35-9476-d4eff5812170 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.848800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 568/1135] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:24.856378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:24.867548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd312838-b662-4565-932a-676848d37e28 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:24.872227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bea47-3eaa-4963-955e-1047f4f4aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:24.872813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bea47-3eaa-4963-955e-1047f4f4aa82 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:24.873115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bea47-3eaa-4963-955e-1047f4f4aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:24.873385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bea47-3eaa-4963-955e-1047f4f4aa82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:24.874179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bea47-3eaa-4963-955e-1047f4f4aa82 admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=eca65349f42a4b53aa051474cd1c98d5) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:24.874521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bea47-3eaa-4963-955e-1047f4f4aa82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:24.876357 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bea47-3eaa-4963-955e-1047f4f4aa82 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:24.882118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 568/1136] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:46:24 2021] GET /identity/v3/role_assignments?user.id=eca65349f42a4b53aa051474cd1c98d5&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:26.950469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83a6e-d480-427f-8590-82d7bcb21b76 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:26.951040 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83a6e-d480-427f-8590-82d7bcb21b76 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:26.951040 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83a6e-d480-427f-8590-82d7bcb21b76 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:26.952692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 569/1137] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:26.957852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fdc0f-328f-4d98-8c48-a662c30488d5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:26.958263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fdc0f-328f-4d98-8c48-a662c30488d5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:26.958438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fdc0f-328f-4d98-8c48-a662c30488d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:26.981261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-631fdc0f-328f-4d98-8c48-a662c30488d5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:26.982393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-631fdc0f-328f-4d98-8c48-a662c30488d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:26.989676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 569/1138] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:27.012061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb83a6e-d480-427f-8590-82d7bcb21b76 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.024395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb83a6e-d480-427f-8590-82d7bcb21b76 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.028534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8cca7-68fc-43fc-a91c-01986b98e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.029273 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8cca7-68fc-43fc-a91c-01986b98e4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.029560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8cca7-68fc-43fc-a91c-01986b98e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.029839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8cca7-68fc-43fc-a91c-01986b98e4d1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.042522 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8cca7-68fc-43fc-a91c-01986b98e4d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:46:27.049287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-23b8cca7-68fc-43fc-a91c-01986b98e4d1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:46:27.050509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 570/1139] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:27.056867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fdc0f-328f-4d98-8c48-a662c30488d5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.065884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fdc0f-328f-4d98-8c48-a662c30488d5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.070867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.071459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.071745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.072023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.072740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:27.073036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.074680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.083227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 570/1140] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:27.089703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8cca7-68fc-43fc-a91c-01986b98e4d1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.099515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8cca7-68fc-43fc-a91c-01986b98e4d1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.103794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.104502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.104785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.105059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.116532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.118334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.136017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:27.137114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 571/1141] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:27.145153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.156589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3a49-51f2-423c-bcd8-2654b831ed46 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.161165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.161848 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.162143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.162456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.163204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:27.163509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.165108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.178013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 571/1142] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:46:27.185902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.203102 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57844da3-db5d-4d9f-84c5-7c9bb290e2e9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.211072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.212364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.212887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.213402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.238121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.240346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.259881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 14:46:27.261037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 572/1143] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/users/placement => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:27.267076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.277350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cb055-50bf-40c8-a72e-44457dfe7eaf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.281748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.282343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.282662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.282952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.283746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:27.284044 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.285882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.315017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 572/1144] 10.222.0.57 () {56 vars in 1164 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:27.321347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.330968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a832f-0c03-4c15-a57e-cb481f0a2bde admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.336010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.336742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.337028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.337308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.349969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.351872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.370179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:27.371349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 573/1145] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 14:46:27.377183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.387892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b830c66-104b-489a-bc73-5401ebaaa823 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.392654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.393327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.393685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.394040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.394869 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:27.395247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.397116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.409839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 573/1146] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:27.416056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.425402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812009-b8da-4962-8fc0-ed7cd6007009 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.430152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.430899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.431184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.431461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.441036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.443028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.457491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:46:27.458635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 574/1147] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:27.464719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.474454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6596db-6bb0-46da-9767-73ea66368a77 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.478778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb11ae-e870-471d-b54c-29ad773a3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.479364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb11ae-e870-471d-b54c-29ad773a3dfb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.479650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb11ae-e870-471d-b54c-29ad773a3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.479927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb11ae-e870-471d-b54c-29ad773a3dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.480667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb11ae-e870-471d-b54c-29ad773a3dfb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:27.480965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb11ae-e870-471d-b54c-29ad773a3dfb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.483074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb11ae-e870-471d-b54c-29ad773a3dfb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.496090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 574/1148] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:46:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:27.502155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:27.512349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f28d-f4ce-4394-a733-75eff9e70ce0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:27.516664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45202478-99d1-4a00-95c1-6df872103d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:27.517468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45202478-99d1-4a00-95c1-6df872103d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:27.517757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45202478-99d1-4a00-95c1-6df872103d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:27.518031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45202478-99d1-4a00-95c1-6df872103d8e admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/eca65349f42a4b53aa051474cd1c98d5/roles/7aaa6f36ae64405697ffb965e125aae6` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:27.537520 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45202478-99d1-4a00-95c1-6df872103d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=eca65349f42a4b53aa051474cd1c98d5, role_id=7aaa6f36ae64405697ffb965e125aae6)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:27.540203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45202478-99d1-4a00-95c1-6df872103d8e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:27.555475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 575/1149] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:46:27 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/eca65349f42a4b53aa051474cd1c98d5/roles/7aaa6f36ae64405697ffb965e125aae6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:46:29.695519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab63308-6cf4-44a4-ad92-6662148bf36f None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:29.696080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab63308-6cf4-44a4-ad92-6662148bf36f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:29.696452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab63308-6cf4-44a4-ad92-6662148bf36f None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:29.698726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 575/1150] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:29.704288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54e33-4fd4-44e0-b262-f4a0bc2c0134 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:29.704839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54e33-4fd4-44e0-b262-f4a0bc2c0134 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:29.704839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54e33-4fd4-44e0-b262-f4a0bc2c0134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:29.728109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-27f54e33-4fd4-44e0-b262-f4a0bc2c0134 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:29.729246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-27f54e33-4fd4-44e0-b262-f4a0bc2c0134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:29.797186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 576/1151] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:29 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:46:29.820576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab63308-6cf4-44a4-ad92-6662148bf36f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:29.836049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab63308-6cf4-44a4-ad92-6662148bf36f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:29.840573 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7fbcf-7778-45a9-aad1-4c2034420cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:29.841294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7fbcf-7778-45a9-aad1-4c2034420cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:29.841597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7fbcf-7778-45a9-aad1-4c2034420cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:29.841865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7fbcf-7778-45a9-aad1-4c2034420cd8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:29.854705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7fbcf-7778-45a9-aad1-4c2034420cd8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:46:29.861566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-80e7fbcf-7778-45a9-aad1-4c2034420cd8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 14:46:29.862759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 576/1152] 10.222.0.57 () {56 vars in 1123 bytes} [Mon Oct 25 14:46:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:29.869934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f54e33-4fd4-44e0-b262-f4a0bc2c0134 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:29.880940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f54e33-4fd4-44e0-b262-f4a0bc2c0134 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:29.885268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:29.885852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:29.886136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:29.886424 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:29.887152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:29.887444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:29.889011 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:29.897203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 577/1153] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 25 14:46:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:29.903563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7fbcf-7778-45a9-aad1-4c2034420cd8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:29.914135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7fbcf-7778-45a9-aad1-4c2034420cd8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:29.918582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:29.919305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:29.919593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:29.919874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:29.931237 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:29.933051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:29.950466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:29.951517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 577/1154] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:29.957735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:29.967717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07460a-fe97-4183-be63-777450ce2e12 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:29.972047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:29.972635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:29.972925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:29.973205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:29.973893 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:29.974191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:29.975808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:29.988889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 578/1155] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:29.994778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:30.004230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38e140-288b-4ffa-8ab2-8b623ba23452 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:30.009115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:30.009837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:30.010126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:30.010423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:30.025249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:30.027291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:30.045409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 14:46:30.046558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 578/1156] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:30.052502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:30.062008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7350b-157e-4730-b0e9-e3b2cc8345c8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:30.068206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:30.069255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:30.070311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:30.070805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:30.072113 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:30.072606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:30.075910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:30.105901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 579/1157] 10.222.0.57 () {56 vars in 1164 bytes} [Mon Oct 25 14:46:30 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:30.111986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:30.121469 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba083-273d-476b-99ed-55203c3335be admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:30.125710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e620-da70-46a8-b4f0-bfa22da91a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:30.126278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e620-da70-46a8-b4f0-bfa22da91a5d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:30.126601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e620-da70-46a8-b4f0-bfa22da91a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:30.126882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e620-da70-46a8-b4f0-bfa22da91a5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:30.135163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2e620-da70-46a8-b4f0-bfa22da91a5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:30.136892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2e620-da70-46a8-b4f0-bfa22da91a5d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:30.145963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 579/1158] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:46:30 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:46:30.152547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:30.162146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb43ab-07e5-46ba-92b5-d98b138ab56d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:30.174306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:30.175092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:30.175365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:30.175647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:30.187629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:30.189445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:30.206810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:30.207848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 580/1159] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:30.214575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e620-da70-46a8-b4f0-bfa22da91a5d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:30.223366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e620-da70-46a8-b4f0-bfa22da91a5d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:30.227837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:30.228417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:30.228707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:30.228989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:30.229683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:30.229982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:30.231590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:30.244243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 580/1160] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:46:30.249978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:30.259886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436084df-203d-4891-81e9-2472139b6fb0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:30.264213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:30.264931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:30.265220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:30.265500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:30.274839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:30.276788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:30.290317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:46:30.291438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 581/1161] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:46:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:30.297449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:30.306700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c48f9-6a3f-4a81-8246-d1ab4f236f62 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:30.310841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb28289-a4c9-488b-b761-7f04ad460e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:30.311417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb28289-a4c9-488b-b761-7f04ad460e2d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:30.311701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb28289-a4c9-488b-b761-7f04ad460e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:30.311978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb28289-a4c9-488b-b761-7f04ad460e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:30.312720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb28289-a4c9-488b-b761-7f04ad460e2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:30.313019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb28289-a4c9-488b-b761-7f04ad460e2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:30.314885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb28289-a4c9-488b-b761-7f04ad460e2d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:30.327991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 581/1162] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:46:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:30.334214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:30.344132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da3be8-8f58-4737-b1ce-4ab613629418 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:30.348446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8bc4c-632e-44fc-9d0e-43a4c2f383fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:30.349016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bc4c-632e-44fc-9d0e-43a4c2f383fc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:30.349298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bc4c-632e-44fc-9d0e-43a4c2f383fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:30.349575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bc4c-632e-44fc-9d0e-43a4c2f383fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:30.350349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8bc4c-632e-44fc-9d0e-43a4c2f383fc admin admin] RBAC: Adding query filter params (role.id=7aaa6f36ae64405697ffb965e125aae6, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=eca65349f42a4b53aa051474cd1c98d5) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:30.350687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8bc4c-632e-44fc-9d0e-43a4c2f383fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:30.352511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8bc4c-632e-44fc-9d0e-43a4c2f383fc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:30.358820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 582/1163] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:46:30 2021] GET /identity/v3/role_assignments?user.id=eca65349f42a4b53aa051474cd1c98d5&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=7aaa6f36ae64405697ffb965e125aae6 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:32.488264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1979cf4-3c78-4f94-a336-df370a8e8769 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.488824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1979cf4-3c78-4f94-a336-df370a8e8769 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.488824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1979cf4-3c78-4f94-a336-df370a8e8769 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.490498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 582/1164] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:32.496632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f970-8d16-4820-a389-78d8e709beff None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.497067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f970-8d16-4820-a389-78d8e709beff None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.497192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f970-8d16-4820-a389-78d8e709beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.521677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-6ef1f970-8d16-4820-a389-78d8e709beff None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:32.523476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6ef1f970-8d16-4820-a389-78d8e709beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:32.530707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 583/1165] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:32 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:32.553595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1979cf4-3c78-4f94-a336-df370a8e8769 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.566066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1979cf4-3c78-4f94-a336-df370a8e8769 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.570900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96eab4-0419-4b5d-8baf-520404d523bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.571637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96eab4-0419-4b5d-8baf-520404d523bf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.571927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96eab4-0419-4b5d-8baf-520404d523bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.572208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96eab4-0419-4b5d-8baf-520404d523bf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.584877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96eab4-0419-4b5d-8baf-520404d523bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:46:32.592165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-4b96eab4-0419-4b5d-8baf-520404d523bf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:46:32.593335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 583/1166] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:32.599634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1f970-8d16-4820-a389-78d8e709beff None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.612462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1f970-8d16-4820-a389-78d8e709beff None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.617417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.618018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.618309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.618622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.619348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:32.619650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.621261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:32.630110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 584/1167] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:32.636716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96eab4-0419-4b5d-8baf-520404d523bf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.646740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96eab4-0419-4b5d-8baf-520404d523bf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.650977 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.651688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.651977 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.652255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.663517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.665320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:32.683314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:32.684445 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 584/1168] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:32.690430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.700596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8013188-4770-4e69-bf11-6120bbabdc33 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.704984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.705566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.705855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.706137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.706859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:32.707161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.708806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:32.721224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 585/1169] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:32.727109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.736835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb7422-e137-4233-b93f-9dedae1d4aad admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.741146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.742332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.742647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.742927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.755683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.758261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:32.776286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 14:46:32.777417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 585/1170] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:32.783382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.792924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d9697-1c51-4946-932d-b773d10dad41 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.797389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.798020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.798305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.798615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.799407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:32.799706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.801553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:32.833222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 586/1171] 10.222.0.57 () {56 vars in 1164 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:32.839100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.848546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157514-2b78-4d49-ab94-deec720c789d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.852759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9ad8-d058-487e-ae71-8f711915f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.853331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9ad8-d058-487e-ae71-8f711915f489 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.853617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9ad8-d058-487e-ae71-8f711915f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.853896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9ad8-d058-487e-ae71-8f711915f489 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.861856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e9ad8-d058-487e-ae71-8f711915f489 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.863619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e9ad8-d058-487e-ae71-8f711915f489 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:32.873026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 586/1172] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:46:32.879008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.889120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c5ec2-27d7-44ed-bdff-fc850c2ed8fc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.893485 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.894201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.894531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.894813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.906543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.908375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:32.925438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:32.926603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 587/1173] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:32.932920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9ad8-d058-487e-ae71-8f711915f489 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.941532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9ad8-d058-487e-ae71-8f711915f489 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.946430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.947018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.947301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.947719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.948277 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:32.948549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.950098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:32.962786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 587/1174] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:32.968780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:32.978171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d70a3-2fb4-48fc-85bf-ad60b7afa6e5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:32.982378 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:32.983375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:32.983770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:32.984056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:32.993242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:32.995162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:33.009587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:46:33.010745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 588/1175] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:46:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:33.016787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:33.026274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9b07-1d18-43fa-b76b-b7c51ca6ab97 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:33.030855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60154cea-c312-4f10-b567-aba36ee977b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:33.031432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154cea-c312-4f10-b567-aba36ee977b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:33.031722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154cea-c312-4f10-b567-aba36ee977b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:33.032004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154cea-c312-4f10-b567-aba36ee977b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:33.032745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60154cea-c312-4f10-b567-aba36ee977b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:33.033048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60154cea-c312-4f10-b567-aba36ee977b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:33.034914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60154cea-c312-4f10-b567-aba36ee977b7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:33.048143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 588/1176] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:46:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:33.054919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:33.064612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47667a5c-1044-4791-921e-c7716853114e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:33.068876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944db99-76e8-437b-ab34-acaef592692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:33.069462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944db99-76e8-437b-ab34-acaef592692f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:33.069755 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944db99-76e8-437b-ab34-acaef592692f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:33.070038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944db99-76e8-437b-ab34-acaef592692f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:33.070856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944db99-76e8-437b-ab34-acaef592692f admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=eca65349f42a4b53aa051474cd1c98d5) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:33.071160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944db99-76e8-437b-ab34-acaef592692f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:33.072980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944db99-76e8-437b-ab34-acaef592692f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:33.078339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 589/1177] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:46:33 2021] GET /identity/v3/role_assignments?user.id=eca65349f42a4b53aa051474cd1c98d5&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=98f77a1006404111a8be8686551c8675 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:35.131794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33598-65f8-478e-be06-9e011e49b1d3 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.132355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33598-65f8-478e-be06-9e011e49b1d3 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.132355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33598-65f8-478e-be06-9e011e49b1d3 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.133936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 589/1178] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:35.139138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc022449-cde6-45ee-ad64-66cf7ff69f76 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.139546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc022449-cde6-45ee-ad64-66cf7ff69f76 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.139709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc022449-cde6-45ee-ad64-66cf7ff69f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.161904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-fc022449-cde6-45ee-ad64-66cf7ff69f76 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:35.163087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fc022449-cde6-45ee-ad64-66cf7ff69f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:35.170737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 590/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:46:35.193014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e33598-65f8-478e-be06-9e011e49b1d3 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.204769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e33598-65f8-478e-be06-9e011e49b1d3 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.208873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7903b-553b-4df6-85a1-7fb4dd62a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.209658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7903b-553b-4df6-85a1-7fb4dd62a030 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.209942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7903b-553b-4df6-85a1-7fb4dd62a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.210738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7903b-553b-4df6-85a1-7fb4dd62a030 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.221641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7903b-553b-4df6-85a1-7fb4dd62a030 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:46:35.228918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-55a7903b-553b-4df6-85a1-7fb4dd62a030 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:46:35.230137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 590/1180] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:35.236989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc022449-cde6-45ee-ad64-66cf7ff69f76 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.246259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc022449-cde6-45ee-ad64-66cf7ff69f76 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.250694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.251314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.251605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.251888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.252620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:35.252918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.254577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.264311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 591/1181] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:35.270361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7903b-553b-4df6-85a1-7fb4dd62a030 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.281655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7903b-553b-4df6-85a1-7fb4dd62a030 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.292306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.293022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.293307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.293587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.305022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.306851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.327635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:35.329092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 591/1182] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:35.334727 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.344712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d4a7e-e214-47c1-bc82-29cfaf6ad9e1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.349039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.349625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.349914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.350197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.350944 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:35.351303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.352826 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.365342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 592/1183] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:35.371165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.380528 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9990b6e-86a4-432f-8870-ea2334c5e760 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.385354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.386022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.386308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.386617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.400913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.402946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.421016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 14:46:35.422158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 592/1184] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:35.428143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.437631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5971bd-bdae-44e8-998c-ceaabf7fca72 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.442120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.442750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.443036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.443315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.444094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:35.444878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.446752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.476397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 593/1185] 10.222.0.57 () {56 vars in 1164 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:35.482138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.491807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9fe3a-014c-4f4c-b8ac-1745f1fc4a67 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.496290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.497006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.497291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.497569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.510186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.512045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.529578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:35.530734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 593/1186] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:35.536745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.546225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e46d2-ef5a-4fbf-815a-a45c869e6360 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.550535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.551143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.551428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.551706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.552389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:35.552688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.554263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.577016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 594/1187] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:35.583364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.593347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1aba5-145c-4eea-9739-281fd6eb57be admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.597664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.598374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.598698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.598980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.607404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.609619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.623950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:46:35.625083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 594/1188] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:35.631280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.641248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55034f-bd60-4707-96e4-e0dc33416a1d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.645602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd2f78-df8c-451c-a5ba-a517a18edd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.646186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2f78-df8c-451c-a5ba-a517a18edd99 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.646500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2f78-df8c-451c-a5ba-a517a18edd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.646782 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2f78-df8c-451c-a5ba-a517a18edd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.647522 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd2f78-df8c-451c-a5ba-a517a18edd99 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:35.647821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd2f78-df8c-451c-a5ba-a517a18edd99 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.649642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd2f78-df8c-451c-a5ba-a517a18edd99 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.662101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 595/1189] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:46:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:35.668385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:35.677898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf13524-a26a-412c-8327-da13d680e6f0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:35.682708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1dfb-192e-4874-8c7e-7d98bed93db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:35.683515 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1dfb-192e-4874-8c7e-7d98bed93db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:35.683803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1dfb-192e-4874-8c7e-7d98bed93db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:35.684083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1dfb-192e-4874-8c7e-7d98bed93db2 admin admin] PATH_INFO: `/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/eca65349f42a4b53aa051474cd1c98d5/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:35.685870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b1dfb-192e-4874-8c7e-7d98bed93db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12549af9dfe0434ebc8a12d37884b63e, user_id=eca65349f42a4b53aa051474cd1c98d5, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:35.688502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b1dfb-192e-4874-8c7e-7d98bed93db2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:35.702318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 595/1190] 10.222.0.57 () {58 vars in 1460 bytes} [Mon Oct 25 14:46:35 2021] PUT /identity/v3/projects/12549af9dfe0434ebc8a12d37884b63e/users/eca65349f42a4b53aa051474cd1c98d5/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:46:37.792510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea350-3d69-4e4f-9809-94d5387c7325 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:37.793061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea350-3d69-4e4f-9809-94d5387c7325 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:37.793061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea350-3d69-4e4f-9809-94d5387c7325 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:37.794794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 596/1191] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:37.799979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bc26-0fe2-4942-a55c-9d947b48e0ed None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:37.800415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bc26-0fe2-4942-a55c-9d947b48e0ed None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:37.800665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bc26-0fe2-4942-a55c-9d947b48e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:37.822966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1d83bc26-0fe2-4942-a55c-9d947b48e0ed None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:37.824100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1d83bc26-0fe2-4942-a55c-9d947b48e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:37.888775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 596/1192] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:37 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:37.913539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ea350-3d69-4e4f-9809-94d5387c7325 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:37.925493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ea350-3d69-4e4f-9809-94d5387c7325 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:37.930840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ee225-f875-417f-9829-3d6c8c18fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:37.931569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee225-f875-417f-9829-3d6c8c18fee7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:37.931856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee225-f875-417f-9829-3d6c8c18fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:37.932137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee225-f875-417f-9829-3d6c8c18fee7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:37.947386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ee225-f875-417f-9829-3d6c8c18fee7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 14:46:37.953973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-812ee225-f875-417f-9829-3d6c8c18fee7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 14:46:37.955155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 597/1193] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 25 14:46:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:37.961526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bc26-0fe2-4942-a55c-9d947b48e0ed None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:37.970263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bc26-0fe2-4942-a55c-9d947b48e0ed None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:37.974497 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:37.975076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:37.975353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:37.975628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:37.976332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:37.976627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:37.978224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:37.986896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 597/1194] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 25 14:46:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:37.993237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ee225-f875-417f-9829-3d6c8c18fee7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.003193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ee225-f875-417f-9829-3d6c8c18fee7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.008187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.008904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.009193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.009475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.020658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.022521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.039798 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:38.040907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 598/1195] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:38.047212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.057375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c2ffb-11ce-4f14-89cb-d4fb1199db7d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.064926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.065995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.066316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.066635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.067344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:38.067647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.069225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.087720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 598/1196] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:38.093619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.103166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45d1e4-7cb5-40af-b4fd-5ffa69e5e350 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.107530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.108517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.108803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.109081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.123654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.125682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.144688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 14:46:38.145809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 599/1197] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/users/placement => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:38.151895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.161345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b835f56-d566-4444-90d1-d71e9234bad6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.165679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.166267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.166597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.166881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.167678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:38.167978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.169794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.199222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 599/1198] 10.222.0.57 () {56 vars in 1164 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:38.205122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.214636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0591d6-129c-452d-b1b5-92c7c2e33a6c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.218903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45ece0-a3b7-442e-a11a-d04be14ea041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.219480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ece0-a3b7-442e-a11a-d04be14ea041 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.219766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ece0-a3b7-442e-a11a-d04be14ea041 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.220046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ece0-a3b7-442e-a11a-d04be14ea041 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.228053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ece0-a3b7-442e-a11a-d04be14ea041 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.229785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ece0-a3b7-442e-a11a-d04be14ea041 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.239142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 600/1199] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:46:38.245655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.255001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4bbaf-b12c-4701-9a09-b6130f8ed9d1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.259898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.260610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.260894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.261169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.272622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.274463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.291790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 14:46:38.292906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 600/1200] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:38.298998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45ece0-a3b7-442e-a11a-d04be14ea041 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.308037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45ece0-a3b7-442e-a11a-d04be14ea041 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.312312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.312891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.313174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.313447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.314118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:38.314428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.316005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.328330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 601/1201] 10.222.0.57 () {56 vars in 1130 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:38.334294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.343982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2943-e55b-4aa5-9983-fc9690f8faa9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.348354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.349066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.349354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.349633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.358919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.360871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.375134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING keystone.server.flask.application [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 14:46:38.376271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 601/1202] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:38.382298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.391874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae66e2e-4209-4166-bc72-c0881e8cf716 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.396125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b032bf-aec9-42db-b477-a527e4c65067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.396706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b032bf-aec9-42db-b477-a527e4c65067 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.396987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b032bf-aec9-42db-b477-a527e4c65067 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.397272 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b032bf-aec9-42db-b477-a527e4c65067 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.398030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b032bf-aec9-42db-b477-a527e4c65067 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:38.398332 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b032bf-aec9-42db-b477-a527e4c65067 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.400186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b032bf-aec9-42db-b477-a527e4c65067 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.412763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 602/1203] 10.222.0.57 () {56 vars in 1169 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:46:38.419457 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:38.429796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bfe93-5f67-4f24-8e63-8e9f9a9edf9c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:38.434062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd20bf-aae1-4a97-8c4c-43002e5a5bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:38.434670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd20bf-aae1-4a97-8c4c-43002e5a5bac admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:38.434961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd20bf-aae1-4a97-8c4c-43002e5a5bac admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:38.435242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd20bf-aae1-4a97-8c4c-43002e5a5bac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:38.436025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd20bf-aae1-4a97-8c4c-43002e5a5bac admin admin] RBAC: Adding query filter params (role.id=98f77a1006404111a8be8686551c8675, scope.project.id=12549af9dfe0434ebc8a12d37884b63e, user.id=eca65349f42a4b53aa051474cd1c98d5) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:38.436331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd20bf-aae1-4a97-8c4c-43002e5a5bac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:38.439021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd20bf-aae1-4a97-8c4c-43002e5a5bac admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:38.447257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 602/1204] 10.222.0.57 () {56 vars in 1395 bytes} [Mon Oct 25 14:46:38 2021] GET /identity/v3/role_assignments?user.id=eca65349f42a4b53aa051474cd1c98d5&scope.project.id=12549af9dfe0434ebc8a12d37884b63e&role.id=98f77a1006404111a8be8686551c8675 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:46:40.555254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61d9a-3b28-439a-8b5a-30b4f8f005e2 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:40.555785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61d9a-3b28-439a-8b5a-30b4f8f005e2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:40.555874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61d9a-3b28-439a-8b5a-30b4f8f005e2 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:40.557553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 603/1205] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:40.562796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5b4f9-78b3-4c71-856d-0c6f90ea4328 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:40.563191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5b4f9-78b3-4c71-856d-0c6f90ea4328 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:40.563362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5b4f9-78b3-4c71-856d-0c6f90ea4328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:40.588089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e5d5b4f9-78b3-4c71-856d-0c6f90ea4328 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:40.589820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e5d5b4f9-78b3-4c71-856d-0c6f90ea4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:40.597978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 603/1206] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:40.620278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb61d9a-3b28-439a-8b5a-30b4f8f005e2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:40.633016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb61d9a-3b28-439a-8b5a-30b4f8f005e2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:40.637328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:40.638086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:40.638372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:40.638686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:40.639324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:40.640950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:40.653051 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 14:46:40.654242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 604/1207] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:46:40 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:40.660719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5b4f9-78b3-4c71-856d-0c6f90ea4328 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:40.669708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5b4f9-78b3-4c71-856d-0c6f90ea4328 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:40.674009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aae383-787a-45c3-b4f0-3fdde3d4ccab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:40.674625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae383-787a-45c3-b4f0-3fdde3d4ccab admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:40.674914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae383-787a-45c3-b4f0-3fdde3d4ccab admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:40.675197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae383-787a-45c3-b4f0-3fdde3d4ccab admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:40.675876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aae383-787a-45c3-b4f0-3fdde3d4ccab admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:40.676175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aae383-787a-45c3-b4f0-3fdde3d4ccab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:40.677764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aae383-787a-45c3-b4f0-3fdde3d4ccab admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:40.682859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 604/1208] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 25 14:46:40 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:40.694838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:40.704199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a91bc-3b9f-4710-be42-cbee2acfda31 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:40.708700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566285-4f48-4ba7-98ab-a401f7a47119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:40.709277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566285-4f48-4ba7-98ab-a401f7a47119 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:40.709557 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566285-4f48-4ba7-98ab-a401f7a47119 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:40.709852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566285-4f48-4ba7-98ab-a401f7a47119 admin admin] PATH_INFO: `/v3/services` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:40.711089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566285-4f48-4ba7-98ab-a401f7a47119 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:40.711380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566285-4f48-4ba7-98ab-a401f7a47119 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:40.712956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566285-4f48-4ba7-98ab-a401f7a47119 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:40.717361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 605/1209] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 25 14:46:40 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:42.786599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb07cfc-4abd-4b69-93dd-9ae442b7b79a None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:42.787158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb07cfc-4abd-4b69-93dd-9ae442b7b79a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:42.787158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb07cfc-4abd-4b69-93dd-9ae442b7b79a None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:42.789366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 605/1210] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:42.795009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7298-fa76-46ca-879b-ae05bcae5e5b None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:42.795422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7298-fa76-46ca-879b-ae05bcae5e5b None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:42.795574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7298-fa76-46ca-879b-ae05bcae5e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:42.817753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-baab7298-fa76-46ca-879b-ae05bcae5e5b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:42.818936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-baab7298-fa76-46ca-879b-ae05bcae5e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:42.826012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 606/1211] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:42.848363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb07cfc-4abd-4b69-93dd-9ae442b7b79a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:42.861188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb07cfc-4abd-4b69-93dd-9ae442b7b79a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:42.865284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0ce4-8efa-4ceb-a10c-1bcb17fd59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:42.865874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0ce4-8efa-4ceb-a10c-1bcb17fd59c8 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:42.866772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0ce4-8efa-4ceb-a10c-1bcb17fd59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:42.867059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0ce4-8efa-4ceb-a10c-1bcb17fd59c8 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:42.867761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c0ce4-8efa-4ceb-a10c-1bcb17fd59c8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:42.869366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c0ce4-8efa-4ceb-a10c-1bcb17fd59c8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:42.883895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 606/1212] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Oct 25 14:46:42 2021] POST /identity/v3/services => generated 246 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:46:45.028140 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efc778-889f-4588-8e03-22280bcb0452 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:45.028712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efc778-889f-4588-8e03-22280bcb0452 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:45.028712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efc778-889f-4588-8e03-22280bcb0452 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:45.030375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 607/1213] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:45.035703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65c63d-3b66-4aa0-8989-a536595c40b7 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:45.036132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65c63d-3b66-4aa0-8989-a536595c40b7 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:45.036285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65c63d-3b66-4aa0-8989-a536595c40b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:45.061402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-da65c63d-3b66-4aa0-8989-a536595c40b7 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:45.062630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-da65c63d-3b66-4aa0-8989-a536595c40b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:45.083155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 607/1214] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:45 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:45.106499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efc778-889f-4588-8e03-22280bcb0452 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:45.118723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efc778-889f-4588-8e03-22280bcb0452 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:45.122868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:45.123595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:45.123884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:45.124164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:45.124787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:45.126429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:45.137755 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 14:46:45.138881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 608/1215] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:46:45 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:45.145288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65c63d-3b66-4aa0-8989-a536595c40b7 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:45.154605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65c63d-3b66-4aa0-8989-a536595c40b7 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:45.158906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:45.159485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:45.159771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:45.160048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:45.160718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:45.161015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:45.162665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:45.168076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 608/1216] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 25 14:46:45 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:45.174136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:45.183400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28334e98-e92b-488d-8b10-a2c4d4cec49c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:45.187645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b9108-df05-48eb-bec1-f880f2201dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:45.188218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b9108-df05-48eb-bec1-f880f2201dfa admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:45.188504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b9108-df05-48eb-bec1-f880f2201dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:45.188781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b9108-df05-48eb-bec1-f880f2201dfa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:45.189521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b9108-df05-48eb-bec1-f880f2201dfa admin admin] RBAC: Adding query filter params (interface=public, service_id=4c249c5076bb419296b3833cef272194, region_id=RegionOne) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:45.189819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b9108-df05-48eb-bec1-f880f2201dfa admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:45.191415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b9108-df05-48eb-bec1-f880f2201dfa admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:45.197364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 609/1217] 10.222.0.57 () {56 vars in 1272 bytes} [Mon Oct 25 14:46:45 2021] GET /identity/v3/endpoints?service_id=4c249c5076bb419296b3833cef272194&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:45.203213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:45.213040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9451647-ebab-465a-9d5b-be9bdb6583c2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:45.217287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35ff5d-7ff6-4a45-8a28-3aa6d9820432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:45.217864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ff5d-7ff6-4a45-8a28-3aa6d9820432 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:45.218150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ff5d-7ff6-4a45-8a28-3aa6d9820432 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:45.218451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ff5d-7ff6-4a45-8a28-3aa6d9820432 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:45.219105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35ff5d-7ff6-4a45-8a28-3aa6d9820432 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:45.220673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35ff5d-7ff6-4a45-8a28-3aa6d9820432 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:45.227873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 609/1218] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:46:45 2021] GET /identity/v3/services => generated 2430 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:46:47.322948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a1c6f-7f48-47a5-81f1-6f4cb049b379 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:47.323500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a1c6f-7f48-47a5-81f1-6f4cb049b379 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:47.323500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a1c6f-7f48-47a5-81f1-6f4cb049b379 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:47.325178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 610/1219] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:46:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:46:47.330552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78808fc-0c4d-48c1-a33b-0845b59b1a4f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:47.330984 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78808fc-0c4d-48c1-a33b-0845b59b1a4f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:47.331121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78808fc-0c4d-48c1-a33b-0845b59b1a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:47.354978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f78808fc-0c4d-48c1-a33b-0845b59b1a4f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:46:47.356144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f78808fc-0c4d-48c1-a33b-0845b59b1a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:46:47.363697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 610/1220] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:46:47 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:46:47.387490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a1c6f-7f48-47a5-81f1-6f4cb049b379 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:47.399438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a1c6f-7f48-47a5-81f1-6f4cb049b379 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:47.403543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:47.404268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:47.404555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:47.404835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:47.405455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:47.407090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:47.418169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING keystone.server.flask.application [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 14:46:47.419311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 611/1221] 10.222.0.57 () {56 vars in 1138 bytes} [Mon Oct 25 14:46:47 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 14:46:47.425505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78808fc-0c4d-48c1-a33b-0845b59b1a4f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:47.434885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78808fc-0c4d-48c1-a33b-0845b59b1a4f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:47.439157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ece082-2514-4583-8193-db1c7ee0ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:47.439741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece082-2514-4583-8193-db1c7ee0ba52 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:47.440027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece082-2514-4583-8193-db1c7ee0ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:47.440306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece082-2514-4583-8193-db1c7ee0ba52 admin admin] PATH_INFO: `/v3/services` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:47.440983 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ece082-2514-4583-8193-db1c7ee0ba52 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:46:47.441283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ece082-2514-4583-8193-db1c7ee0ba52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:47.442900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ece082-2514-4583-8193-db1c7ee0ba52 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:47.447996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 611/1222] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 25 14:46:47 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:46:47.453841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:46:47.463960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6479c3-f8e8-44b6-aeba-6fb8313901eb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:46:47.468257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d46d5b-9b1c-452f-80c0-a5d9a4cfa6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:46:47.468823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46d5b-9b1c-452f-80c0-a5d9a4cfa6ed admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:46:47.469108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46d5b-9b1c-452f-80c0-a5d9a4cfa6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:46:47.469385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46d5b-9b1c-452f-80c0-a5d9a4cfa6ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:46:47.470065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d46d5b-9b1c-452f-80c0-a5d9a4cfa6ed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:46:47.471686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d46d5b-9b1c-452f-80c0-a5d9a4cfa6ed admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:46:47.492028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 612/1223] 10.222.0.57 () {60 vars in 1165 bytes} [Mon Oct 25 14:46:47 2021] POST /identity/v3/endpoints => generated 331 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:48:14.763798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c07a-547c-4a0f-9258-03e9aef7a3e5 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:14.764384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c07a-547c-4a0f-9258-03e9aef7a3e5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:14.764384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c07a-547c-4a0f-9258-03e9aef7a3e5 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:14.766185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 612/1224] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:14.771582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb074a-7263-4547-b194-5baaf8fd6ff6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:14.772222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb074a-7263-4547-b194-5baaf8fd6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:14.772222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb074a-7263-4547-b194-5baaf8fd6ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:14.866926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-58fb074a-7263-4547-b194-5baaf8fd6ff6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:14.868010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-58fb074a-7263-4547-b194-5baaf8fd6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:14.986046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 613/1225] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:15.009517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9c07a-547c-4a0f-9258-03e9aef7a3e5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:15.011244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d7b9c07a-547c-4a0f-9258-03e9aef7a3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:15.167628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9c07a-547c-4a0f-9258-03e9aef7a3e5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:15.282844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450be17-bd73-46ac-9857-d2d2dd4ecca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:15.283453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450be17-bd73-46ac-9857-d2d2dd4ecca2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:15.283741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450be17-bd73-46ac-9857-d2d2dd4ecca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:15.284019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450be17-bd73-46ac-9857-d2d2dd4ecca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:15.284737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450be17-bd73-46ac-9857-d2d2dd4ecca2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:15.286669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450be17-bd73-46ac-9857-d2d2dd4ecca2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:15.303020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 613/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:48:15 2021] GET /identity/v3/projects => generated 2553 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:48:17.614075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07794a-52c6-4b82-8ba9-08fe174dfe51 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:17.614708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07794a-52c6-4b82-8ba9-08fe174dfe51 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:17.614708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07794a-52c6-4b82-8ba9-08fe174dfe51 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:17.616332 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 614/1227] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:17.622096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e685-1ee7-46ba-b6cb-d9ff904d3959 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:17.622615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e685-1ee7-46ba-b6cb-d9ff904d3959 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:17.622763 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e685-1ee7-46ba-b6cb-d9ff904d3959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:17.715603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-9683e685-1ee7-46ba-b6cb-d9ff904d3959 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:17.716686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9683e685-1ee7-46ba-b6cb-d9ff904d3959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:17.827948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 614/1228] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:17.879423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3c39-5171-44cf-92d8-4394ea72398e None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:17.879709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3c39-5171-44cf-92d8-4394ea72398e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:17.879988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3c39-5171-44cf-92d8-4394ea72398e None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:17.881658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 615/1229] 10.222.0.57 () {54 vars in 963 bytes} [Mon Oct 25 14:48:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:17.887832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6088-a6a1-408f-9677-e8fb5a5f0d94 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:17.888126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6088-a6a1-408f-9677-e8fb5a5f0d94 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:17.888440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6088-a6a1-408f-9677-e8fb5a5f0d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:17.985376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d58e6088-a6a1-408f-9677-e8fb5a5f0d94 None None] MFA Rules not processed for user `b7a70a0361b648d6a4233546a1d4901d`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:17.986464 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d58e6088-a6a1-408f-9677-e8fb5a5f0d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:18.074791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 615/1230] 10.222.0.57 () {58 vars in 1060 bytes} [Mon Oct 25 14:48:17 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:18.083946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d3c39-5171-44cf-92d8-4394ea72398e None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:18.085883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ec1d3c39-5171-44cf-92d8-4394ea72398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:18.203647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d3c39-5171-44cf-92d8-4394ea72398e None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:18.287604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7ca37-51f2-41c4-adfd-14ecce5492a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:18.288661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ca37-51f2-41c4-adfd-14ecce5492a7 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:18.288952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ca37-51f2-41c4-adfd-14ecce5492a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:18.289235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ca37-51f2-41c4-adfd-14ecce5492a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:18.290822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0df7ca37-51f2-41c4-adfd-14ecce5492a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:18.415846 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7ca37-51f2-41c4-adfd-14ecce5492a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:18.417302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7ca37-51f2-41c4-adfd-14ecce5492a7 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:18.438821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 616/1231] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:48:20.817395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3633b-1e86-4ef0-bbf4-2f8a107bda59 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:20.817921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3633b-1e86-4ef0-bbf4-2f8a107bda59 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:20.818000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3633b-1e86-4ef0-bbf4-2f8a107bda59 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:20.819961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 616/1232] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:20.825259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a8743-935a-46ec-a41c-676c3ed31a9f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:20.825753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a8743-935a-46ec-a41c-676c3ed31a9f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:20.825966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a8743-935a-46ec-a41c-676c3ed31a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:20.910527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e01a8743-935a-46ec-a41c-676c3ed31a9f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:20.911697 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e01a8743-935a-46ec-a41c-676c3ed31a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:21.024794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 617/1233] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:21.062883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3633b-1e86-4ef0-bbf4-2f8a107bda59 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:21.064381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8ad3633b-1e86-4ef0-bbf4-2f8a107bda59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:21.182026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3633b-1e86-4ef0-bbf4-2f8a107bda59 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:21.264501 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91925643-dca0-48e9-b5f2-2d3f3d6ad79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:21.265081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91925643-dca0-48e9-b5f2-2d3f3d6ad79a service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:21.265368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91925643-dca0-48e9-b5f2-2d3f3d6ad79a service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:21.265647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91925643-dca0-48e9-b5f2-2d3f3d6ad79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:21.267220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-91925643-dca0-48e9-b5f2-2d3f3d6ad79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:21.389242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91925643-dca0-48e9-b5f2-2d3f3d6ad79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:21.390705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91925643-dca0-48e9-b5f2-2d3f3d6ad79a service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:21.411713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 617/1234] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:23.854200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d0c66-0a88-4459-8fd9-7ceab4f7a0d0 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:23.854720 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d0c66-0a88-4459-8fd9-7ceab4f7a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:23.854846 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d0c66-0a88-4459-8fd9-7ceab4f7a0d0 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:23.856540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 618/1235] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:23.862234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaca0a-eb37-4191-9a38-61dabc40d043 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:23.862733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaca0a-eb37-4191-9a38-61dabc40d043 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:23.862835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaca0a-eb37-4191-9a38-61dabc40d043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:23.947184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-cbeaca0a-eb37-4191-9a38-61dabc40d043 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:23.948350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-cbeaca0a-eb37-4191-9a38-61dabc40d043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:24.054333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 618/1236] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:24.089545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d0c66-0a88-4459-8fd9-7ceab4f7a0d0 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:24.091136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ae9d0c66-0a88-4459-8fd9-7ceab4f7a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:24.231564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d0c66-0a88-4459-8fd9-7ceab4f7a0d0 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:24.341321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce128a13-ccff-4b4c-a925-1125c3ee9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:24.341998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce128a13-ccff-4b4c-a925-1125c3ee9db4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:24.342284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce128a13-ccff-4b4c-a925-1125c3ee9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:24.342593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce128a13-ccff-4b4c-a925-1125c3ee9db4 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:24.353377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce128a13-ccff-4b4c-a925-1125c3ee9db4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:24.355503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce128a13-ccff-4b4c-a925-1125c3ee9db4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:24.357122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 619/1237] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:48:24 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:48:24.370576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaca0a-eb37-4191-9a38-61dabc40d043 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:24.371720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-cbeaca0a-eb37-4191-9a38-61dabc40d043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:24.479693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaca0a-eb37-4191-9a38-61dabc40d043 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:24.567071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66224302-6198-41d3-8d81-201204b33ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:24.567649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66224302-6198-41d3-8d81-201204b33ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:24.567934 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66224302-6198-41d3-8d81-201204b33ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:24.568214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66224302-6198-41d3-8d81-201204b33ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:24.570301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-66224302-6198-41d3-8d81-201204b33ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:24.697418 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66224302-6198-41d3-8d81-201204b33ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:24.698793 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66224302-6198-41d3-8d81-201204b33ce2 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:24.719717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 619/1238] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:27.475430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c702e-ce4e-4c1e-8c28-3c4edf1fba81 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:27.475997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c702e-ce4e-4c1e-8c28-3c4edf1fba81 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:27.475997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c702e-ce4e-4c1e-8c28-3c4edf1fba81 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:27.477692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 620/1239] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:27.483080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c419e5f-6a59-4f9d-9b90-7b7fecbf53e8 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:27.483753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c419e5f-6a59-4f9d-9b90-7b7fecbf53e8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:27.483892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c419e5f-6a59-4f9d-9b90-7b7fecbf53e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:27.573046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-3c419e5f-6a59-4f9d-9b90-7b7fecbf53e8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:27.574198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-3c419e5f-6a59-4f9d-9b90-7b7fecbf53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:27.685739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 620/1240] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:27.726516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c702e-ce4e-4c1e-8c28-3c4edf1fba81 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:27.726516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-621c702e-ce4e-4c1e-8c28-3c4edf1fba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:27.880855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c702e-ce4e-4c1e-8c28-3c4edf1fba81 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:27.987676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748164b-a153-4556-829f-7d7f96f23602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:27.988377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748164b-a153-4556-829f-7d7f96f23602 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:27.988666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748164b-a153-4556-829f-7d7f96f23602 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:27.988943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748164b-a153-4556-829f-7d7f96f23602 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:27.999787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748164b-a153-4556-829f-7d7f96f23602 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:28.001834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748164b-a153-4556-829f-7d7f96f23602 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:28.003476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 621/1241] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:48:27 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:48:28.027810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705be91-3352-4ee5-9988-001ad6f8bc3a None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:28.028102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705be91-3352-4ee5-9988-001ad6f8bc3a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:28.028385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705be91-3352-4ee5-9988-001ad6f8bc3a None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:28.030089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 621/1242] 10.222.0.57 () {54 vars in 963 bytes} [Mon Oct 25 14:48:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:28.036111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0444fa-7d12-4575-9ce5-5de49f9e0e02 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:28.036400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0444fa-7d12-4575-9ce5-5de49f9e0e02 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:28.036677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0444fa-7d12-4575-9ce5-5de49f9e0e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:28.132764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-ec0444fa-7d12-4575-9ce5-5de49f9e0e02 None None] MFA Rules not processed for user `b7a70a0361b648d6a4233546a1d4901d`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:28.133966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ec0444fa-7d12-4575-9ce5-5de49f9e0e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:28.220631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 622/1243] 10.222.0.57 () {58 vars in 1060 bytes} [Mon Oct 25 14:48:28 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:28.230006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705be91-3352-4ee5-9988-001ad6f8bc3a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:28.231562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a705be91-3352-4ee5-9988-001ad6f8bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:28.349538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705be91-3352-4ee5-9988-001ad6f8bc3a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:28.434238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a88f6-9650-4b9e-9d13-278a208ea32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:28.434848 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a88f6-9650-4b9e-9d13-278a208ea32a service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:28.435136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a88f6-9650-4b9e-9d13-278a208ea32a service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:28.435422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a88f6-9650-4b9e-9d13-278a208ea32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:28.436975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-797a88f6-9650-4b9e-9d13-278a208ea32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:28.559803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a88f6-9650-4b9e-9d13-278a208ea32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:28.561239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a88f6-9650-4b9e-9d13-278a208ea32a service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:28.580107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 622/1244] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:31.944645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9afefd-eb5f-4190-b11c-b42d8d7028f5 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:31.945348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9afefd-eb5f-4190-b11c-b42d8d7028f5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:31.945348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9afefd-eb5f-4190-b11c-b42d8d7028f5 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:31.947256 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 623/1245] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:48:31.953424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d6fde-6cd1-4d89-b50f-9e21f2522f0f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:31.953998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d6fde-6cd1-4d89-b50f-9e21f2522f0f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:31.954162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d6fde-6cd1-4d89-b50f-9e21f2522f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:32.058377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c73d6fde-6cd1-4d89-b50f-9e21f2522f0f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:32.059599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c73d6fde-6cd1-4d89-b50f-9e21f2522f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:32.180502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 623/1246] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:32.218579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9afefd-eb5f-4190-b11c-b42d8d7028f5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:32.220238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ed9afefd-eb5f-4190-b11c-b42d8d7028f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:32.353639 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9afefd-eb5f-4190-b11c-b42d8d7028f5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:32.453224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006913c-f3fe-4890-9559-132c2e6461f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:32.453819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006913c-f3fe-4890-9559-132c2e6461f8 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:32.454106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006913c-f3fe-4890-9559-132c2e6461f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:32.454386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006913c-f3fe-4890-9559-132c2e6461f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:32.456001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1006913c-f3fe-4890-9559-132c2e6461f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:32.601514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006913c-f3fe-4890-9559-132c2e6461f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:32.602996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006913c-f3fe-4890-9559-132c2e6461f8 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:32.624007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 624/1247] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:35.717565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec81b-e449-4580-82d6-6356bcf53f51 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:35.718095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec81b-e449-4580-82d6-6356bcf53f51 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:35.718181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec81b-e449-4580-82d6-6356bcf53f51 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:35.719880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 624/1248] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:35.725546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e2365-62a7-43f3-80db-ef0efb2af6c9 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:35.726015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e2365-62a7-43f3-80db-ef0efb2af6c9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:35.726132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e2365-62a7-43f3-80db-ef0efb2af6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:35.813213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-404e2365-62a7-43f3-80db-ef0efb2af6c9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:35.814356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-404e2365-62a7-43f3-80db-ef0efb2af6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:35.920207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 625/1249] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:48:35.956511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ec81b-e449-4580-82d6-6356bcf53f51 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:35.957958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-de9ec81b-e449-4580-82d6-6356bcf53f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:36.079018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ec81b-e449-4580-82d6-6356bcf53f51 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:36.162478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cd484-83e3-4ead-a0ba-90e94f2f3160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:36.163056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cd484-83e3-4ead-a0ba-90e94f2f3160 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:36.163339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cd484-83e3-4ead-a0ba-90e94f2f3160 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:36.163613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cd484-83e3-4ead-a0ba-90e94f2f3160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:36.165138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6c8cd484-83e3-4ead-a0ba-90e94f2f3160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:36.286703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cd484-83e3-4ead-a0ba-90e94f2f3160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:36.288670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cd484-83e3-4ead-a0ba-90e94f2f3160 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:36.308247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 625/1250] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:38.469767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88515-93c5-47bd-a2c8-4d6f051ead13 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:38.470333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88515-93c5-47bd-a2c8-4d6f051ead13 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:38.470333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88515-93c5-47bd-a2c8-4d6f051ead13 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:38.472102 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 626/1251] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:38.478969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164fb36-e178-4a05-99fb-2eaf0b7cbadc None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:38.479527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164fb36-e178-4a05-99fb-2eaf0b7cbadc None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:38.479527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164fb36-e178-4a05-99fb-2eaf0b7cbadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:38.567714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6164fb36-e178-4a05-99fb-2eaf0b7cbadc None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:38.568927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6164fb36-e178-4a05-99fb-2eaf0b7cbadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:38.673839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 626/1252] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:38.706130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88515-93c5-47bd-a2c8-4d6f051ead13 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:38.707641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d8a88515-93c5-47bd-a2c8-4d6f051ead13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:38.855433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88515-93c5-47bd-a2c8-4d6f051ead13 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:38.958669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cded0d0-fb06-4bc4-a155-82d7a9f493b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:38.960045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded0d0-fb06-4bc4-a155-82d7a9f493b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:38.960324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded0d0-fb06-4bc4-a155-82d7a9f493b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:38.960596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded0d0-fb06-4bc4-a155-82d7a9f493b1 admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:38.971519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cded0d0-fb06-4bc4-a155-82d7a9f493b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:38.973576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cded0d0-fb06-4bc4-a155-82d7a9f493b1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:38.975356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 627/1253] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:48:38 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:48:38.987850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164fb36-e178-4a05-99fb-2eaf0b7cbadc None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:38.989003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6164fb36-e178-4a05-99fb-2eaf0b7cbadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:39.093243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164fb36-e178-4a05-99fb-2eaf0b7cbadc None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:39.177488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4fdf7-6269-4713-a8ab-3039a951009e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:39.178533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4fdf7-6269-4713-a8ab-3039a951009e service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:39.178822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4fdf7-6269-4713-a8ab-3039a951009e service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:39.179101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4fdf7-6269-4713-a8ab-3039a951009e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:39.180665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fba4fdf7-6269-4713-a8ab-3039a951009e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:39.301964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4fdf7-6269-4713-a8ab-3039a951009e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:39.303971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4fdf7-6269-4713-a8ab-3039a951009e service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:39.323996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 627/1254] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:41.687261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a091b-7b21-4edb-aba0-eef26a2571ce None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:41.687825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a091b-7b21-4edb-aba0-eef26a2571ce None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:41.687825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a091b-7b21-4edb-aba0-eef26a2571ce None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:41.689483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 628/1255] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:41.695767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc0515-c9ac-4cf5-9338-8e665f35488a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:41.696207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc0515-c9ac-4cf5-9338-8e665f35488a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:41.696366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc0515-c9ac-4cf5-9338-8e665f35488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:41.790304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-bbbc0515-c9ac-4cf5-9338-8e665f35488a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:41.791493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bbbc0515-c9ac-4cf5-9338-8e665f35488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:41.904454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 628/1256] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:41.940794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a091b-7b21-4edb-aba0-eef26a2571ce None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:41.942357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2f7a091b-7b21-4edb-aba0-eef26a2571ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:42.064539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a091b-7b21-4edb-aba0-eef26a2571ce None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:42.150534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26420-5f41-48fc-9c47-6449d961c96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:42.151118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26420-5f41-48fc-9c47-6449d961c96f service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:42.151403 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26420-5f41-48fc-9c47-6449d961c96f service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:42.151681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26420-5f41-48fc-9c47-6449d961c96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:42.153222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bdd26420-5f41-48fc-9c47-6449d961c96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:42.276728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26420-5f41-48fc-9c47-6449d961c96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:42.278066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26420-5f41-48fc-9c47-6449d961c96f service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:42.297524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 629/1257] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:44.455115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3545-2c32-4792-a9c2-9dd30d7940d0 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:44.455647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3545-2c32-4792-a9c2-9dd30d7940d0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:44.455741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3545-2c32-4792-a9c2-9dd30d7940d0 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:44.457391 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 629/1258] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:44.463257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a9b1a-d2c9-4932-b70c-23a1d49b2c78 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:44.463691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a9b1a-d2c9-4932-b70c-23a1d49b2c78 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:44.463952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a9b1a-d2c9-4932-b70c-23a1d49b2c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:44.555354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-bb4a9b1a-d2c9-4932-b70c-23a1d49b2c78 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:44.556565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bb4a9b1a-d2c9-4932-b70c-23a1d49b2c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:44.664015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 630/1259] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:44.704743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b3545-2c32-4792-a9c2-9dd30d7940d0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:44.706236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bd1b3545-2c32-4792-a9c2-9dd30d7940d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:44.842252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b3545-2c32-4792-a9c2-9dd30d7940d0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:44.927066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d88376-81ef-45dd-96e3-0f102553bce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:44.927565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88376-81ef-45dd-96e3-0f102553bce7 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:44.927887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88376-81ef-45dd-96e3-0f102553bce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:44.928169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88376-81ef-45dd-96e3-0f102553bce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:44.929712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-33d88376-81ef-45dd-96e3-0f102553bce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:45.059661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d88376-81ef-45dd-96e3-0f102553bce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:45.061102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d88376-81ef-45dd-96e3-0f102553bce7 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:45.081151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 630/1260] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:47.676101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7f43b-b585-4eae-98d6-7bc15e4a4b98 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:47.676802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7f43b-b585-4eae-98d6-7bc15e4a4b98 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:47.676802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7f43b-b585-4eae-98d6-7bc15e4a4b98 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:47.679185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 631/1261] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:48:47.685354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7400-bdc8-4f05-ac15-a8afe74a220e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:47.685807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7400-bdc8-4f05-ac15-a8afe74a220e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:47.685911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7400-bdc8-4f05-ac15-a8afe74a220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:47.782348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-2a2f7400-bdc8-4f05-ac15-a8afe74a220e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:47.783548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2a2f7400-bdc8-4f05-ac15-a8afe74a220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:47.903823 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 631/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:47.940092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7f43b-b585-4eae-98d6-7bc15e4a4b98 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:47.942158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bbb7f43b-b585-4eae-98d6-7bc15e4a4b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:48.053757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7f43b-b585-4eae-98d6-7bc15e4a4b98 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:48.057180 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc524b3-d97a-4c2e-b8a1-cd443d1b25d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:48.057754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc524b3-d97a-4c2e-b8a1-cd443d1b25d0 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:48.058037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc524b3-d97a-4c2e-b8a1-cd443d1b25d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:48.058311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc524b3-d97a-4c2e-b8a1-cd443d1b25d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:48.067388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc524b3-d97a-4c2e-b8a1-cd443d1b25d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:48.069436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc524b3-d97a-4c2e-b8a1-cd443d1b25d0 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:48.078817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 632/1263] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:52.613536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4497cd-b6e7-4cc5-b51e-4def34ef19ef None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:52.614109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4497cd-b6e7-4cc5-b51e-4def34ef19ef None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:52.614109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4497cd-b6e7-4cc5-b51e-4def34ef19ef None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:52.615811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 632/1264] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:52.621564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe7b6-70ad-4899-b4d3-62731f815c77 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:52.622192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe7b6-70ad-4899-b4d3-62731f815c77 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:52.622192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe7b6-70ad-4899-b4d3-62731f815c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:52.647703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0ffbe7b6-70ad-4899-b4d3-62731f815c77 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:52.648887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0ffbe7b6-70ad-4899-b4d3-62731f815c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:52.663779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 633/1265] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:52.731208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4497cd-b6e7-4cc5-b51e-4def34ef19ef None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:52.743038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4497cd-b6e7-4cc5-b51e-4def34ef19ef None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:52.746634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ac9c8-7dad-4a4b-a39a-1246e6e9834d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:52.747226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ac9c8-7dad-4a4b-a39a-1246e6e9834d service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:52.747507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ac9c8-7dad-4a4b-a39a-1246e6e9834d service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:52.747785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ac9c8-7dad-4a4b-a39a-1246e6e9834d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:52.757753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ac9c8-7dad-4a4b-a39a-1246e6e9834d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:52.759251 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ac9c8-7dad-4a4b-a39a-1246e6e9834d service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:52.769238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 633/1266] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:48:55.885934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d36c9-3543-4b33-8d6f-6af0ed5d21f4 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:55.886541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d36c9-3543-4b33-8d6f-6af0ed5d21f4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:55.886541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d36c9-3543-4b33-8d6f-6af0ed5d21f4 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:55.888173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 634/1267] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:48:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:48:55.894000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3356a-e053-4ec3-aeff-a6ac5cdd19a7 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:55.894471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3356a-e053-4ec3-aeff-a6ac5cdd19a7 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:55.894598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3356a-e053-4ec3-aeff-a6ac5cdd19a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:55.917850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f7f3356a-e053-4ec3-aeff-a6ac5cdd19a7 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:48:55.919048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f7f3356a-e053-4ec3-aeff-a6ac5cdd19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:48:55.926764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 634/1268] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:48:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:48:55.964939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d36c9-3543-4b33-8d6f-6af0ed5d21f4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:48:55.975800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d36c9-3543-4b33-8d6f-6af0ed5d21f4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:48:55.979107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab37cf4-2259-4cdd-a2de-4993287472e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:48:55.979688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab37cf4-2259-4cdd-a2de-4993287472e5 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:48:55.979973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab37cf4-2259-4cdd-a2de-4993287472e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:48:55.980252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab37cf4-2259-4cdd-a2de-4993287472e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:48:55.990226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab37cf4-2259-4cdd-a2de-4993287472e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:48:55.991682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab37cf4-2259-4cdd-a2de-4993287472e5 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:48:56.000859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 635/1269] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:48:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:01.151759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcfda1-1f51-420f-8114-e836d33a6044 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:01.152364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcfda1-1f51-420f-8114-e836d33a6044 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:01.152696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcfda1-1f51-420f-8114-e836d33a6044 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:01.155962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 635/1270] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:01.164840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5db9-24fa-4694-aa44-8613c9b86e4e None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:01.165631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5db9-24fa-4694-aa44-8613c9b86e4e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:01.165631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5db9-24fa-4694-aa44-8613c9b86e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:01.190855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1ebc5db9-24fa-4694-aa44-8613c9b86e4e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:01.192641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1ebc5db9-24fa-4694-aa44-8613c9b86e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:01.204619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 636/1271] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:01.255234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcfda1-1f51-420f-8114-e836d33a6044 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:01.266967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcfda1-1f51-420f-8114-e836d33a6044 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:01.271789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7eb1d-d293-4211-9705-1f2e86c35093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:01.272476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7eb1d-d293-4211-9705-1f2e86c35093 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:01.272843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7eb1d-d293-4211-9705-1f2e86c35093 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:01.273213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7eb1d-d293-4211-9705-1f2e86c35093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:01.288489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7eb1d-d293-4211-9705-1f2e86c35093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:01.291409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7eb1d-d293-4211-9705-1f2e86c35093 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:01.310790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 636/1272] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:06.241993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c80ef-40f5-48a7-afde-54e8d61b9f33 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:06.243208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c80ef-40f5-48a7-afde-54e8d61b9f33 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:06.243492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c80ef-40f5-48a7-afde-54e8d61b9f33 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:06.247021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 637/1273] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 14:49:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:06.251819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4909b-be16-48b1-8738-f7c0ba868037 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:06.252693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4909b-be16-48b1-8738-f7c0ba868037 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:06.253179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4909b-be16-48b1-8738-f7c0ba868037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:06.360236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-dfa4909b-be16-48b1-8738-f7c0ba868037 None None] MFA Rules not processed for user `eca65349f42a4b53aa051474cd1c98d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:06.361812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-dfa4909b-be16-48b1-8738-f7c0ba868037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:06.473979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 637/1274] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 14:49:06 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:49:06.972073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbb97-81c6-476d-a4a5-3cf230e52f2e None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:06.972745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbb97-81c6-476d-a4a5-3cf230e52f2e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:06.973403 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbb97-81c6-476d-a4a5-3cf230e52f2e None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:06.976460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 638/1275] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 14:49:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:06.982002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f8dbe-719d-4fc8-a388-587afc52bed4 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:06.982339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f8dbe-719d-4fc8-a388-587afc52bed4 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:06.982614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f8dbe-719d-4fc8-a388-587afc52bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:07.008721 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-186f8dbe-719d-4fc8-a388-587afc52bed4 None None] MFA Rules not processed for user `eca65349f42a4b53aa051474cd1c98d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:07.010078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-186f8dbe-719d-4fc8-a388-587afc52bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:07.019804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 638/1276] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 14:49:06 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:12.359380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c1551-0fd6-4f65-ab96-2f5713e2a69e None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:12.360664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c1551-0fd6-4f65-ab96-2f5713e2a69e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:12.361196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c1551-0fd6-4f65-ab96-2f5713e2a69e None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:12.364050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 639/1277] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 14:49:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:12.374726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9db75-7e3e-47e1-b84d-33a268ddfe8b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:12.375472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9db75-7e3e-47e1-b84d-33a268ddfe8b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:12.375472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9db75-7e3e-47e1-b84d-33a268ddfe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:12.403217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7bf9db75-7e3e-47e1-b84d-33a268ddfe8b None None] MFA Rules not processed for user `eca65349f42a4b53aa051474cd1c98d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:12.404765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7bf9db75-7e3e-47e1-b84d-33a268ddfe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:12.415928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 639/1278] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 14:49:12 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:49:14.130613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f3a5-f9bb-4e60-a13c-cf56e7123a0c None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:14.131172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f3a5-f9bb-4e60-a13c-cf56e7123a0c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:14.131461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f3a5-f9bb-4e60-a13c-cf56e7123a0c None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:14.133839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 640/1279] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 14:49:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:49:14.140249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1161ce6-0a35-49a6-8376-d2de11f3bc02 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:14.140803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1161ce6-0a35-49a6-8376-d2de11f3bc02 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:14.141240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1161ce6-0a35-49a6-8376-d2de11f3bc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:14.172125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e1161ce6-0a35-49a6-8376-d2de11f3bc02 None None] MFA Rules not processed for user `eca65349f42a4b53aa051474cd1c98d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:14.173551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e1161ce6-0a35-49a6-8376-d2de11f3bc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:14.183641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 640/1280] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 14:49:14 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:17.965347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3996e1-e4f3-4ba3-8ca4-d78e906c536e None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:17.966059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3996e1-e4f3-4ba3-8ca4-d78e906c536e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:17.966059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3996e1-e4f3-4ba3-8ca4-d78e906c536e None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:17.967694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 641/1281] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:49:17.973372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599fdd-bfc5-4678-863b-530aff74ad2b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:17.973854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599fdd-bfc5-4678-863b-530aff74ad2b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:17.973950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599fdd-bfc5-4678-863b-530aff74ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:17.996040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6d599fdd-bfc5-4678-863b-530aff74ad2b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:17.997177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6d599fdd-bfc5-4678-863b-530aff74ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:18.004254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 641/1282] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:18.052142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89adca3-c6a5-470b-a2ac-e77957a596b8 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:18.052423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89adca3-c6a5-470b-a2ac-e77957a596b8 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:18.052731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89adca3-c6a5-470b-a2ac-e77957a596b8 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:18.054390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 642/1283] 10.222.0.57 () {54 vars in 954 bytes} [Mon Oct 25 14:49:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:18.059986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547dde2-4b4b-4491-94d0-c4ee3b519232 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:18.060281 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547dde2-4b4b-4491-94d0-c4ee3b519232 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:18.060569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547dde2-4b4b-4491-94d0-c4ee3b519232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:18.133995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-5547dde2-4b4b-4491-94d0-c4ee3b519232 None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:18.135096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5547dde2-4b4b-4491-94d0-c4ee3b519232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:18.225838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 642/1284] 10.222.0.57 () {58 vars in 1051 bytes} [Mon Oct 25 14:49:18 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:18.234226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89adca3-c6a5-470b-a2ac-e77957a596b8 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:18.249034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89adca3-c6a5-470b-a2ac-e77957a596b8 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:18.254347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc58a5-695f-4bc7-a796-8b56afdf5793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:18.255587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc58a5-695f-4bc7-a796-8b56afdf5793 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:18.255870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc58a5-695f-4bc7-a796-8b56afdf5793 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:18.256145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc58a5-695f-4bc7-a796-8b56afdf5793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:18.265667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc58a5-695f-4bc7-a796-8b56afdf5793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:18.267327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc58a5-695f-4bc7-a796-8b56afdf5793 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:18.277663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 643/1285] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:20.717271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1e537-a762-41ef-b590-036720f1f480 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:20.717842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1e537-a762-41ef-b590-036720f1f480 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:20.717842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1e537-a762-41ef-b590-036720f1f480 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:20.719567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 643/1286] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:20.725188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150203c-576a-411a-817c-f3bddda150af None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:20.725614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150203c-576a-411a-817c-f3bddda150af None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:20.725753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150203c-576a-411a-817c-f3bddda150af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:20.747865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1150203c-576a-411a-817c-f3bddda150af None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:20.749003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1150203c-576a-411a-817c-f3bddda150af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:20.756690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 644/1287] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:20.800564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1e537-a762-41ef-b590-036720f1f480 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:20.815238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1e537-a762-41ef-b590-036720f1f480 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:20.821137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2502eef-7551-43f9-9bb6-9c8d62a18db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:20.821735 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502eef-7551-43f9-9bb6-9c8d62a18db7 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:20.822176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502eef-7551-43f9-9bb6-9c8d62a18db7 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:20.822499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502eef-7551-43f9-9bb6-9c8d62a18db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:20.831745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2502eef-7551-43f9-9bb6-9c8d62a18db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:20.834014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2502eef-7551-43f9-9bb6-9c8d62a18db7 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:20.844614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 644/1288] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:23.360816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a8d32-e71e-4920-8667-d6783e75dad3 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:23.361419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a8d32-e71e-4920-8667-d6783e75dad3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:23.361419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a8d32-e71e-4920-8667-d6783e75dad3 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:23.363234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 645/1289] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:23.369388 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0cd7-8a1c-4b49-9af4-930fbb4bde90 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:23.369965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0cd7-8a1c-4b49-9af4-930fbb4bde90 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:23.369965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0cd7-8a1c-4b49-9af4-930fbb4bde90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:23.393062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0f8b0cd7-8a1c-4b49-9af4-930fbb4bde90 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:23.394265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0f8b0cd7-8a1c-4b49-9af4-930fbb4bde90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:23.402045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 645/1290] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:23.449668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e188b-8a2f-42b8-b01a-62eecf09a110 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:23.449957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e188b-8a2f-42b8-b01a-62eecf09a110 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:23.450260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e188b-8a2f-42b8-b01a-62eecf09a110 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:23.452783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 646/1291] 10.222.0.57 () {54 vars in 954 bytes} [Mon Oct 25 14:49:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:23.459069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205699-c39d-45e8-a2cb-bef9d3292df6 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:23.459362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205699-c39d-45e8-a2cb-bef9d3292df6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:23.459645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205699-c39d-45e8-a2cb-bef9d3292df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:23.482713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-03205699-c39d-45e8-a2cb-bef9d3292df6 None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:23.484147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-03205699-c39d-45e8-a2cb-bef9d3292df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:23.492591 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 646/1292] 10.222.0.57 () {58 vars in 1051 bytes} [Mon Oct 25 14:49:23 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:49:23.500462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e188b-8a2f-42b8-b01a-62eecf09a110 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:23.513939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e188b-8a2f-42b8-b01a-62eecf09a110 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:23.519212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4681734-3276-4929-a5bf-2cdb8c7ba19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:23.519778 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4681734-3276-4929-a5bf-2cdb8c7ba19d service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:23.520621 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4681734-3276-4929-a5bf-2cdb8c7ba19d service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:23.520898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4681734-3276-4929-a5bf-2cdb8c7ba19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:23.529290 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4681734-3276-4929-a5bf-2cdb8c7ba19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:23.530912 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4681734-3276-4929-a5bf-2cdb8c7ba19d service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:23.540991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 647/1293] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:25.719471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565661-52c2-4913-a1d7-ec7593509fe7 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:25.720062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565661-52c2-4913-a1d7-ec7593509fe7 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:25.720062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565661-52c2-4913-a1d7-ec7593509fe7 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:25.721757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 647/1294] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:25.728566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bf5ea-74eb-4111-8157-df190d91d30c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:25.729141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bf5ea-74eb-4111-8157-df190d91d30c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:25.729141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bf5ea-74eb-4111-8157-df190d91d30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:25.753142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-269bf5ea-74eb-4111-8157-df190d91d30c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:25.754313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-269bf5ea-74eb-4111-8157-df190d91d30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:25.762857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 648/1295] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:25.806741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565661-52c2-4913-a1d7-ec7593509fe7 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:25.821129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565661-52c2-4913-a1d7-ec7593509fe7 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:25.826381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dd852-6849-401a-8d15-356bd843dd36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:25.826989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dd852-6849-401a-8d15-356bd843dd36 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:25.827279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dd852-6849-401a-8d15-356bd843dd36 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:25.827563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dd852-6849-401a-8d15-356bd843dd36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:25.836368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dd852-6849-401a-8d15-356bd843dd36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:25.838149 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dd852-6849-401a-8d15-356bd843dd36 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:25.847769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 648/1296] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:28.032233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8fd54-a0ee-4f5c-87e6-7a28e7c4a149 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:28.032845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8fd54-a0ee-4f5c-87e6-7a28e7c4a149 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:28.032845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8fd54-a0ee-4f5c-87e6-7a28e7c4a149 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:28.034496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 649/1297] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:28.040494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809715-55fb-4888-98a0-f3c7cdc1e1ac None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:28.040963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809715-55fb-4888-98a0-f3c7cdc1e1ac None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:28.041087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809715-55fb-4888-98a0-f3c7cdc1e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:28.068540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-32809715-55fb-4888-98a0-f3c7cdc1e1ac None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:28.070353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-32809715-55fb-4888-98a0-f3c7cdc1e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:28.079474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 649/1298] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:28.125681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8fd54-a0ee-4f5c-87e6-7a28e7c4a149 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:28.141736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8fd54-a0ee-4f5c-87e6-7a28e7c4a149 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:28.147844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc970aa-bc02-4bc2-84b1-fe03e10d9b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:28.148441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc970aa-bc02-4bc2-84b1-fe03e10d9b8e service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:28.148723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc970aa-bc02-4bc2-84b1-fe03e10d9b8e service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:28.149000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc970aa-bc02-4bc2-84b1-fe03e10d9b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:28.158788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc970aa-bc02-4bc2-84b1-fe03e10d9b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:28.161403 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc970aa-bc02-4bc2-84b1-fe03e10d9b8e service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:28.171610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 650/1299] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:30.325673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8597c-9d0b-4920-93bb-fbbea43ccf81 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:30.326220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8597c-9d0b-4920-93bb-fbbea43ccf81 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:30.326220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8597c-9d0b-4920-93bb-fbbea43ccf81 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:30.327942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 650/1300] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:30.333852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c03b-3422-4b16-b96c-01ef020d7b3f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:30.334266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c03b-3422-4b16-b96c-01ef020d7b3f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:30.334449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c03b-3422-4b16-b96c-01ef020d7b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:30.356890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-efb5c03b-3422-4b16-b96c-01ef020d7b3f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:30.358157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-efb5c03b-3422-4b16-b96c-01ef020d7b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:30.366150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 651/1301] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:30.409772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8597c-9d0b-4920-93bb-fbbea43ccf81 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:30.424009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8597c-9d0b-4920-93bb-fbbea43ccf81 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:30.429070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c05dd-4a6c-44c3-a54d-170d75fc542a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:30.429636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c05dd-4a6c-44c3-a54d-170d75fc542a service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:30.429926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c05dd-4a6c-44c3-a54d-170d75fc542a service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:30.430207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c05dd-4a6c-44c3-a54d-170d75fc542a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:30.438508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c05dd-4a6c-44c3-a54d-170d75fc542a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:30.440071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c05dd-4a6c-44c3-a54d-170d75fc542a service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:30.449619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 651/1302] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:32.607748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d871d9-7d42-424e-b38c-38fc206b079d None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:32.608327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d871d9-7d42-424e-b38c-38fc206b079d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:32.608327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d871d9-7d42-424e-b38c-38fc206b079d None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:32.610262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 652/1303] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:32.615584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f96e93-1218-470f-acba-7be04a34b32b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:32.616033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f96e93-1218-470f-acba-7be04a34b32b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:32.616141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f96e93-1218-470f-acba-7be04a34b32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:32.637954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e0f96e93-1218-470f-acba-7be04a34b32b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:32.639128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e0f96e93-1218-470f-acba-7be04a34b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:32.647103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 652/1304] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:32.688593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d871d9-7d42-424e-b38c-38fc206b079d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:32.704594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d871d9-7d42-424e-b38c-38fc206b079d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:32.710278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468c9c-c1b0-46b7-8125-eeefa3fdb67b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:32.710871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468c9c-c1b0-46b7-8125-eeefa3fdb67b service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:32.711160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468c9c-c1b0-46b7-8125-eeefa3fdb67b service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:32.711438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468c9c-c1b0-46b7-8125-eeefa3fdb67b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:32.719532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468c9c-c1b0-46b7-8125-eeefa3fdb67b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:32.721118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468c9c-c1b0-46b7-8125-eeefa3fdb67b service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:32.731856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 653/1305] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:34.833068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1892b-fa23-45b8-acd8-4a6a4f56aa09 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:34.833627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1892b-fa23-45b8-acd8-4a6a4f56aa09 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:34.833627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1892b-fa23-45b8-acd8-4a6a4f56aa09 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:34.835549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 653/1306] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:34.840850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f312f-6641-4cd2-b80d-230771558bcd None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:34.841320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f312f-6641-4cd2-b80d-230771558bcd None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:34.841418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f312f-6641-4cd2-b80d-230771558bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:34.864186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-292f312f-6641-4cd2-b80d-230771558bcd None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:34.865335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-292f312f-6641-4cd2-b80d-230771558bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:34.872543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 654/1307] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:34.916568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1892b-fa23-45b8-acd8-4a6a4f56aa09 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:34.930811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1892b-fa23-45b8-acd8-4a6a4f56aa09 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:34.935890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c3196-441a-4b93-a771-169b7531fcc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:34.936455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3196-441a-4b93-a771-169b7531fcc0 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:34.936745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3196-441a-4b93-a771-169b7531fcc0 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:34.937027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3196-441a-4b93-a771-169b7531fcc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:34.945438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c3196-441a-4b93-a771-169b7531fcc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:34.947155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c3196-441a-4b93-a771-169b7531fcc0 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:34.956273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 654/1308] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:37.106314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53805de5-22a2-4fdf-aa68-8930a76b64d7 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:37.106896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53805de5-22a2-4fdf-aa68-8930a76b64d7 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:37.106896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53805de5-22a2-4fdf-aa68-8930a76b64d7 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:37.108547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 655/1309] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:37.114835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cefff-1162-4a1a-8855-7edecd645c15 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:37.115241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cefff-1162-4a1a-8855-7edecd645c15 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:37.115397 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cefff-1162-4a1a-8855-7edecd645c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:37.137619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-248cefff-1162-4a1a-8855-7edecd645c15 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:37.138822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-248cefff-1162-4a1a-8855-7edecd645c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:37.146299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 655/1310] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:37.190712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53805de5-22a2-4fdf-aa68-8930a76b64d7 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:37.204115 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53805de5-22a2-4fdf-aa68-8930a76b64d7 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:37.209191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187335a-0d64-4c19-b60b-a561229d94d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:37.209676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187335a-0d64-4c19-b60b-a561229d94d3 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:37.209960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187335a-0d64-4c19-b60b-a561229d94d3 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:37.210235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187335a-0d64-4c19-b60b-a561229d94d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:37.218177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187335a-0d64-4c19-b60b-a561229d94d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:37.219771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187335a-0d64-4c19-b60b-a561229d94d3 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:37.229359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 656/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:39.405253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394c6c-bcbf-4ca4-9650-3961d356c22f None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:39.405831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394c6c-bcbf-4ca4-9650-3961d356c22f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:39.405985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394c6c-bcbf-4ca4-9650-3961d356c22f None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:39.407698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 656/1312] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:39.413584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97fccf-6f06-451f-b694-966d31d0a318 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:39.414018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97fccf-6f06-451f-b694-966d31d0a318 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:39.414147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97fccf-6f06-451f-b694-966d31d0a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:39.436635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-9e97fccf-6f06-451f-b694-966d31d0a318 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:39.437787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9e97fccf-6f06-451f-b694-966d31d0a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:39.445457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 657/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:39.489913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394c6c-bcbf-4ca4-9650-3961d356c22f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:39.503399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394c6c-bcbf-4ca4-9650-3961d356c22f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:39.508521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cec3d-6f37-48cb-b2ed-aaffb50e0f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:39.509085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cec3d-6f37-48cb-b2ed-aaffb50e0f80 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:39.509370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cec3d-6f37-48cb-b2ed-aaffb50e0f80 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:39.509648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cec3d-6f37-48cb-b2ed-aaffb50e0f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:39.517837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cec3d-6f37-48cb-b2ed-aaffb50e0f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:39.519453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cec3d-6f37-48cb-b2ed-aaffb50e0f80 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:39.528484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 657/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:41.670235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508ca6-5a90-4eb7-aab0-22a622c32a7d None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:41.671132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508ca6-5a90-4eb7-aab0-22a622c32a7d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:41.671132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508ca6-5a90-4eb7-aab0-22a622c32a7d None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:41.672523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 658/1315] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:41.680700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a346e-d1ac-4996-8947-554c85002719 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:41.681463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a346e-d1ac-4996-8947-554c85002719 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:41.681889 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a346e-d1ac-4996-8947-554c85002719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:41.721995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-022a346e-d1ac-4996-8947-554c85002719 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:41.723559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-022a346e-d1ac-4996-8947-554c85002719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:41.731007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 658/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:41.777397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e508ca6-5a90-4eb7-aab0-22a622c32a7d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:41.792713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e508ca6-5a90-4eb7-aab0-22a622c32a7d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:41.798284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7fe7c-8fe0-4cd2-8bf6-4ef99bf86743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:41.798869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7fe7c-8fe0-4cd2-8bf6-4ef99bf86743 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:41.799344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7fe7c-8fe0-4cd2-8bf6-4ef99bf86743 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:41.799453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7fe7c-8fe0-4cd2-8bf6-4ef99bf86743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:41.808488 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7fe7c-8fe0-4cd2-8bf6-4ef99bf86743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:41.809984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7fe7c-8fe0-4cd2-8bf6-4ef99bf86743 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:41.821521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 659/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:49:43.970832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a957-c7f9-4164-ab8c-299a96df8bef None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:43.971547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a957-c7f9-4164-ab8c-299a96df8bef None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:43.971547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a957-c7f9-4164-ab8c-299a96df8bef None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:43.973128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 659/1318] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:43.979178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe1a06-b5b2-423d-a266-03b65524ba24 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:43.979682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe1a06-b5b2-423d-a266-03b65524ba24 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:43.979782 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe1a06-b5b2-423d-a266-03b65524ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:44.002073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c9fe1a06-b5b2-423d-a266-03b65524ba24 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:44.003278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c9fe1a06-b5b2-423d-a266-03b65524ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:44.011382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 660/1319] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:44.056672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027a957-c7f9-4164-ab8c-299a96df8bef None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:44.071117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027a957-c7f9-4164-ab8c-299a96df8bef None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:44.076189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c825df-7d16-4fb7-a22a-fc094881c279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:44.076757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c825df-7d16-4fb7-a22a-fc094881c279 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:44.077197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c825df-7d16-4fb7-a22a-fc094881c279 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:44.077421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c825df-7d16-4fb7-a22a-fc094881c279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:44.086604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c825df-7d16-4fb7-a22a-fc094881c279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:44.088219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c825df-7d16-4fb7-a22a-fc094881c279 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:44.097764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 660/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:49:54.891663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579662-fd18-4f67-a6ed-124282f10646 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:54.892269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579662-fd18-4f67-a6ed-124282f10646 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:54.892269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579662-fd18-4f67-a6ed-124282f10646 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:54.893921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 661/1321] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:49:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:54.899596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a575-9f3e-4898-a211-097f51886da7 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:54.900108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a575-9f3e-4898-a211-097f51886da7 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:54.900197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a575-9f3e-4898-a211-097f51886da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:54.922645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7635a575-9f3e-4898-a211-097f51886da7 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:54.923800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7635a575-9f3e-4898-a211-097f51886da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:54.932080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 661/1322] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:49:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:49:54.996041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41520a6-9c66-40a9-b332-a7766f88d79d None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:54.996326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41520a6-9c66-40a9-b332-a7766f88d79d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:54.996786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41520a6-9c66-40a9-b332-a7766f88d79d None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:54.998563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 662/1323] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 25 14:49:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:49:55.004411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4de41-0477-4b42-9fc5-4dd887059dbd None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:55.004706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4de41-0477-4b42-9fc5-4dd887059dbd None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:55.004986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4de41-0477-4b42-9fc5-4dd887059dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:55.091079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f5e4de41-0477-4b42-9fc5-4dd887059dbd None None] MFA Rules not processed for user `29ed619258a14a148654f372f3a6a6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:49:55.092660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f5e4de41-0477-4b42-9fc5-4dd887059dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:49:55.172575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 662/1324] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 25 14:49:55 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:49:55.187150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41520a6-9c66-40a9-b332-a7766f88d79d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:49:55.199129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41520a6-9c66-40a9-b332-a7766f88d79d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:49:55.202885 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87e717-7523-4716-8b69-7001afb34d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:49:55.203493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e717-7523-4716-8b69-7001afb34d54 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:49:55.203785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e717-7523-4716-8b69-7001afb34d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:49:55.204060 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e717-7523-4716-8b69-7001afb34d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:49:55.214084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87e717-7523-4716-8b69-7001afb34d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:49:55.215567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87e717-7523-4716-8b69-7001afb34d54 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:49:55.226184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 663/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:49:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:50:14.491284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589df28-f2b8-45bd-abc0-83d4c2d36234 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:14.491879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589df28-f2b8-45bd-abc0-83d4c2d36234 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:14.491879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589df28-f2b8-45bd-abc0-83d4c2d36234 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:14.493560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 663/1326] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:50:14.499306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684734c4-bb60-458b-867b-73d2a831f6f0 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:14.499994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684734c4-bb60-458b-867b-73d2a831f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:14.499994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684734c4-bb60-458b-867b-73d2a831f6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:14.522996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-684734c4-bb60-458b-867b-73d2a831f6f0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:14.524147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-684734c4-bb60-458b-867b-73d2a831f6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:14.531344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 664/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:14.586230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f39e4-b33c-48f5-a7bb-4ee734e934ed None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:14.586548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f39e4-b33c-48f5-a7bb-4ee734e934ed None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:14.586862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f39e4-b33c-48f5-a7bb-4ee734e934ed None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:14.588587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 664/1328] 10.222.0.57 () {54 vars in 956 bytes} [Mon Oct 25 14:50:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:14.593638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b1d3-d9b4-4c54-a9ee-ac70250354e7 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:14.593934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b1d3-d9b4-4c54-a9ee-ac70250354e7 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:14.594379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b1d3-d9b4-4c54-a9ee-ac70250354e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:14.667810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0d50b1d3-d9b4-4c54-a9ee-ac70250354e7 None None] MFA Rules not processed for user `c92f456ee8cf4564aaca2b16f320b49d`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:14.668917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0d50b1d3-d9b4-4c54-a9ee-ac70250354e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:14.744752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 665/1329] 10.222.0.57 () {58 vars in 1053 bytes} [Mon Oct 25 14:50:14 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:14.752394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f39e4-b33c-48f5-a7bb-4ee734e934ed None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:14.764038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f39e4-b33c-48f5-a7bb-4ee734e934ed None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:14.767628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548672b-78b8-4330-8f60-8235467a7628 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92f456ee8cf4564aaca2b16f320b49d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:14.768199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548672b-78b8-4330-8f60-8235467a7628 service glance] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:14.768487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548672b-78b8-4330-8f60-8235467a7628 service glance] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:14.768769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548672b-78b8-4330-8f60-8235467a7628 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:14.778076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548672b-78b8-4330-8f60-8235467a7628 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:14.779657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548672b-78b8-4330-8f60-8235467a7628 service glance] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:14.789275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 665/1330] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:50:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:50:15.281207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b569-62c2-4d7f-83dd-d6737e512715 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:15.281814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b569-62c2-4d7f-83dd-d6737e512715 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:15.282382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b569-62c2-4d7f-83dd-d6737e512715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:15.374343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b071b569-62c2-4d7f-83dd-d6737e512715 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:15.375660 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b071b569-62c2-4d7f-83dd-d6737e512715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:15.465307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 666/1331] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 14:50:15 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:15.508728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14fec-a80a-427a-8698-0e275ec119be None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:15.509228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14fec-a80a-427a-8698-0e275ec119be None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:15.509316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14fec-a80a-427a-8698-0e275ec119be None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:15.511038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 666/1332] 10.222.0.57 () {54 vars in 942 bytes} [Mon Oct 25 14:50:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:15.517606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955efa7-9f5a-4a24-b516-670dc876c172 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:15.518339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955efa7-9f5a-4a24-b516-670dc876c172 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:15.518549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955efa7-9f5a-4a24-b516-670dc876c172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:15.592730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-9955efa7-9f5a-4a24-b516-670dc876c172 None None] MFA Rules not processed for user `514d94b70d2d4b14b99a9b235942723e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:15.593904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9955efa7-9f5a-4a24-b516-670dc876c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:15.679574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 667/1333] 10.222.0.57 () {58 vars in 1039 bytes} [Mon Oct 25 14:50:15 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:15.689056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14fec-a80a-427a-8698-0e275ec119be None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:15.704378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14fec-a80a-427a-8698-0e275ec119be None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:15.709596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659eb12-58a0-4fab-972e-85c16781dd9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:15.710173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659eb12-58a0-4fab-972e-85c16781dd9a service swift] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:15.710493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659eb12-58a0-4fab-972e-85c16781dd9a service swift] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:15.710775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659eb12-58a0-4fab-972e-85c16781dd9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:15.726337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659eb12-58a0-4fab-972e-85c16781dd9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:15.729521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659eb12-58a0-4fab-972e-85c16781dd9a service swift] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:15.741817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 667/1334] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 14:50:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 14:50:32.398316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666262b-001d-4412-80d5-926584c33801 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:32.398930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666262b-001d-4412-80d5-926584c33801 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:32.398930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666262b-001d-4412-80d5-926584c33801 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:32.400664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 668/1335] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:32.405981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704ffb0-c928-46f6-9f59-5219aa66281b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:32.406489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704ffb0-c928-46f6-9f59-5219aa66281b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:32.406594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704ffb0-c928-46f6-9f59-5219aa66281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:32.429941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1704ffb0-c928-46f6-9f59-5219aa66281b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:32.431589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1704ffb0-c928-46f6-9f59-5219aa66281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:32.439405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 668/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:32.463685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666262b-001d-4412-80d5-926584c33801 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:32.475791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666262b-001d-4412-80d5-926584c33801 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:32.479990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31bb3f-f31b-416b-b0d5-6059f082df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:32.480564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31bb3f-f31b-416b-b0d5-6059f082df26 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:32.480851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31bb3f-f31b-416b-b0d5-6059f082df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:32.481127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31bb3f-f31b-416b-b0d5-6059f082df26 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:32.481819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31bb3f-f31b-416b-b0d5-6059f082df26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:32.483946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31bb3f-f31b-416b-b0d5-6059f082df26 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:32.498658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 669/1337] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:50:32 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:50:34.574721 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fcbe-d20f-44f0-ac39-a31284b1945f None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:34.575141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fcbe-d20f-44f0-ac39-a31284b1945f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:34.575284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fcbe-d20f-44f0-ac39-a31284b1945f None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:34.576995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 669/1338] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:34.582521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678b1c-48ee-4c48-82f0-87083154803d None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:34.582984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678b1c-48ee-4c48-82f0-87083154803d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:34.583095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678b1c-48ee-4c48-82f0-87083154803d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:34.605229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-3b678b1c-48ee-4c48-82f0-87083154803d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:34.606356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3b678b1c-48ee-4c48-82f0-87083154803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:34.614360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 670/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:34.636769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8fcbe-d20f-44f0-ac39-a31284b1945f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:34.648674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8fcbe-d20f-44f0-ac39-a31284b1945f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:34.652979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81247b4f-9c93-41d4-81e0-0288c49a9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:34.653759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81247b4f-9c93-41d4-81e0-0288c49a9f85 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:34.654042 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81247b4f-9c93-41d4-81e0-0288c49a9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:34.654318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81247b4f-9c93-41d4-81e0-0288c49a9f85 admin admin] PATH_INFO: `/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:34.666551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81247b4f-9c93-41d4-81e0-0288c49a9f85 admin admin] RBAC: Authorizing `identity:get_project(project_id=31dfb32762cb4f4d8bd754f4c0e39e2c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:34.668576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81247b4f-9c93-41d4-81e0-0288c49a9f85 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:34.670312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 670/1340] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:50:34 2021] GET /identity/v3/projects/31dfb32762cb4f4d8bd754f4c0e39e2c => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:34.676993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b678b1c-48ee-4c48-82f0-87083154803d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:34.685813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b678b1c-48ee-4c48-82f0-87083154803d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:34.690103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c27bf-bf69-46c2-b793-5d0eb103d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:34.690872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c27bf-bf69-46c2-b793-5d0eb103d315 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:34.691162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c27bf-bf69-46c2-b793-5d0eb103d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:34.691494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c27bf-bf69-46c2-b793-5d0eb103d315 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:34.692208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c27bf-bf69-46c2-b793-5d0eb103d315 admin admin] RBAC: Adding query filter params (scope.project.id=31dfb32762cb4f4d8bd754f4c0e39e2c) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:50:34.692502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c27bf-bf69-46c2-b793-5d0eb103d315 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:34.694353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c27bf-bf69-46c2-b793-5d0eb103d315 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:34.700500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 671/1341] 10.222.0.57 () {56 vars in 1231 bytes} [Mon Oct 25 14:50:34 2021] GET /identity/v3/role_assignments?scope.project.id=31dfb32762cb4f4d8bd754f4c0e39e2c => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:34.706627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81247b4f-9c93-41d4-81e0-0288c49a9f85 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:34.716086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81247b4f-9c93-41d4-81e0-0288c49a9f85 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:34.720630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0bdb-0f31-45a8-b402-a8675147482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:34.721941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0bdb-0f31-45a8-b402-a8675147482c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:34.722250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0bdb-0f31-45a8-b402-a8675147482c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:34.722553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0bdb-0f31-45a8-b402-a8675147482c admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:34.741557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0bdb-0f31-45a8-b402-a8675147482c admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:34.743707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0bdb-0f31-45a8-b402-a8675147482c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:34.745234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 671/1342] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:34 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:36.920928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6a5f5-b86e-43d6-8222-8e70989ee2d2 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:36.921490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6a5f5-b86e-43d6-8222-8e70989ee2d2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:36.921490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6a5f5-b86e-43d6-8222-8e70989ee2d2 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:36.923215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 672/1343] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:36.929213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6c5e-82ce-41c1-b157-cbe8d442fb16 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:36.929635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6c5e-82ce-41c1-b157-cbe8d442fb16 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:36.929783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6c5e-82ce-41c1-b157-cbe8d442fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:36.951651 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1cbe6c5e-82ce-41c1-b157-cbe8d442fb16 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:36.952791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1cbe6c5e-82ce-41c1-b157-cbe8d442fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:36.960325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 672/1344] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:36.983601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6a5f5-b86e-43d6-8222-8e70989ee2d2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:36.996629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6a5f5-b86e-43d6-8222-8e70989ee2d2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:37.000866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d88ed-3721-4b56-86fc-73cd02e1582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:37.001641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d88ed-3721-4b56-86fc-73cd02e1582a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:37.001928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d88ed-3721-4b56-86fc-73cd02e1582a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:37.002211 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d88ed-3721-4b56-86fc-73cd02e1582a admin admin] PATH_INFO: `/v3/projects/8de23d66a8de47dbaa30df02a935afe2` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:37.003384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d88ed-3721-4b56-86fc-73cd02e1582a admin admin] RBAC: Authorizing `identity:get_project(project_id=8de23d66a8de47dbaa30df02a935afe2)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:37.005164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d88ed-3721-4b56-86fc-73cd02e1582a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:37.006779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 673/1345] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:50:36 2021] GET /identity/v3/projects/8de23d66a8de47dbaa30df02a935afe2 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:50:37.013064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe6c5e-82ce-41c1-b157-cbe8d442fb16 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:37.021974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe6c5e-82ce-41c1-b157-cbe8d442fb16 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:37.026294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c4e41-16da-4f72-8c1d-1fac8306be46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:37.026906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4e41-16da-4f72-8c1d-1fac8306be46 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:37.027197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4e41-16da-4f72-8c1d-1fac8306be46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:37.027482 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4e41-16da-4f72-8c1d-1fac8306be46 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:37.028209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4e41-16da-4f72-8c1d-1fac8306be46 admin admin] RBAC: Adding query filter params (scope.project.id=8de23d66a8de47dbaa30df02a935afe2) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:50:37.028520 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4e41-16da-4f72-8c1d-1fac8306be46 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:37.030352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4e41-16da-4f72-8c1d-1fac8306be46 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:37.036732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 673/1346] 10.222.0.57 () {56 vars in 1231 bytes} [Mon Oct 25 14:50:37 2021] GET /identity/v3/role_assignments?scope.project.id=8de23d66a8de47dbaa30df02a935afe2 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:37.042954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d88ed-3721-4b56-86fc-73cd02e1582a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:37.053222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d88ed-3721-4b56-86fc-73cd02e1582a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:37.057771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3503c-af68-46bc-8830-2bfb28175c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:37.058631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3503c-af68-46bc-8830-2bfb28175c0e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:37.058915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3503c-af68-46bc-8830-2bfb28175c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:37.059194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3503c-af68-46bc-8830-2bfb28175c0e admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:37.060284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3503c-af68-46bc-8830-2bfb28175c0e admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:37.062101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3503c-af68-46bc-8830-2bfb28175c0e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:37.063657 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 674/1347] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:37 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:39.187503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79f0b-ee41-431f-9d72-9ba386209b82 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:39.188014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79f0b-ee41-431f-9d72-9ba386209b82 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:39.188014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79f0b-ee41-431f-9d72-9ba386209b82 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:39.189685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 674/1348] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:39.195085 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c826a-eeb0-4d61-bb47-5feecafd3c83 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:39.195537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c826a-eeb0-4d61-bb47-5feecafd3c83 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:39.195655 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c826a-eeb0-4d61-bb47-5feecafd3c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:39.217353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e27c826a-eeb0-4d61-bb47-5feecafd3c83 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:39.218533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e27c826a-eeb0-4d61-bb47-5feecafd3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:39.226296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 675/1349] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:39.248844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab79f0b-ee41-431f-9d72-9ba386209b82 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:39.260904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab79f0b-ee41-431f-9d72-9ba386209b82 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:39.265273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5bd81-42ea-4205-9359-f609e0910cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:39.266053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5bd81-42ea-4205-9359-f609e0910cce admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:39.266341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5bd81-42ea-4205-9359-f609e0910cce admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:39.266659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5bd81-42ea-4205-9359-f609e0910cce admin admin] PATH_INFO: `/v3/projects/989a347eacd0420687609d722541402c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:39.281629 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5bd81-42ea-4205-9359-f609e0910cce admin admin] RBAC: Authorizing `identity:get_project(project_id=989a347eacd0420687609d722541402c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:39.284214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5bd81-42ea-4205-9359-f609e0910cce admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:39.285852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 675/1350] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:50:39 2021] GET /identity/v3/projects/989a347eacd0420687609d722541402c => generated 361 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:39.292268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c826a-eeb0-4d61-bb47-5feecafd3c83 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:39.301635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c826a-eeb0-4d61-bb47-5feecafd3c83 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:39.306494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff90b-fb29-4484-b787-93d24d91c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:39.307112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff90b-fb29-4484-b787-93d24d91c3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:39.307419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff90b-fb29-4484-b787-93d24d91c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:39.307692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff90b-fb29-4484-b787-93d24d91c3d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:39.308442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff90b-fb29-4484-b787-93d24d91c3d9 admin admin] RBAC: Adding query filter params (scope.project.id=989a347eacd0420687609d722541402c) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:50:39.308736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff90b-fb29-4484-b787-93d24d91c3d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:39.310651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff90b-fb29-4484-b787-93d24d91c3d9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:39.316175 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 676/1351] 10.222.0.57 () {56 vars in 1231 bytes} [Mon Oct 25 14:50:39 2021] GET /identity/v3/role_assignments?scope.project.id=989a347eacd0420687609d722541402c => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:39.322108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5bd81-42ea-4205-9359-f609e0910cce admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:39.331620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5bd81-42ea-4205-9359-f609e0910cce admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:39.335917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfb721-c562-4c47-897f-b6cbcbc9b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:39.336725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb721-c562-4c47-897f-b6cbcbc9b564 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:39.337011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb721-c562-4c47-897f-b6cbcbc9b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:39.337288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb721-c562-4c47-897f-b6cbcbc9b564 admin admin] PATH_INFO: `/v3/users/3d7b2befa93e4afc9e18e4210e9269d7` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:39.357714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfb721-c562-4c47-897f-b6cbcbc9b564 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d7b2befa93e4afc9e18e4210e9269d7)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:39.360168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfb721-c562-4c47-897f-b6cbcbc9b564 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:39.361743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 676/1352] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:39 2021] GET /identity/v3/users/3d7b2befa93e4afc9e18e4210e9269d7 => generated 311 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:50:41.486550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a197f-cc02-4767-9976-fb67e5fa420a None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:41.487623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a197f-cc02-4767-9976-fb67e5fa420a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:41.487739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a197f-cc02-4767-9976-fb67e5fa420a None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:41.489384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 677/1353] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:41.495905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27383-6834-4754-b669-231295390d59 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:41.496366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27383-6834-4754-b669-231295390d59 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:41.496458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27383-6834-4754-b669-231295390d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:41.519680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-29d27383-6834-4754-b669-231295390d59 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:41.520819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-29d27383-6834-4754-b669-231295390d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:41.527959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 677/1354] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:41.551256 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a197f-cc02-4767-9976-fb67e5fa420a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:41.563399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a197f-cc02-4767-9976-fb67e5fa420a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:41.570977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185ba93-d6fa-4e44-8f4e-5458bca9867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:41.570977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ba93-d6fa-4e44-8f4e-5458bca9867d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:41.570977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ba93-d6fa-4e44-8f4e-5458bca9867d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:41.570977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ba93-d6fa-4e44-8f4e-5458bca9867d admin admin] PATH_INFO: `/v3/projects/d0feee55b86c461dadc08b5ae307d3b5` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:41.583420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185ba93-d6fa-4e44-8f4e-5458bca9867d admin admin] RBAC: Authorizing `identity:get_project(project_id=d0feee55b86c461dadc08b5ae307d3b5)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:41.585452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185ba93-d6fa-4e44-8f4e-5458bca9867d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:41.587148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 678/1355] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:50:41 2021] GET /identity/v3/projects/d0feee55b86c461dadc08b5ae307d3b5 => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:41.593242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27383-6834-4754-b669-231295390d59 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:41.602650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27383-6834-4754-b669-231295390d59 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:41.606945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b4fe-5fb9-4d12-a8fe-34778636e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:41.607519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b4fe-5fb9-4d12-a8fe-34778636e1ef admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:41.607808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b4fe-5fb9-4d12-a8fe-34778636e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:41.608090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b4fe-5fb9-4d12-a8fe-34778636e1ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:41.609071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12b4fe-5fb9-4d12-a8fe-34778636e1ef admin admin] RBAC: Adding query filter params (scope.project.id=d0feee55b86c461dadc08b5ae307d3b5) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:50:41.609377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12b4fe-5fb9-4d12-a8fe-34778636e1ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:41.611234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12b4fe-5fb9-4d12-a8fe-34778636e1ef admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:41.617337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 678/1356] 10.222.0.57 () {56 vars in 1231 bytes} [Mon Oct 25 14:50:41 2021] GET /identity/v3/role_assignments?scope.project.id=d0feee55b86c461dadc08b5ae307d3b5 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:41.623208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185ba93-d6fa-4e44-8f4e-5458bca9867d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:41.633293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185ba93-d6fa-4e44-8f4e-5458bca9867d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:41.638044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bed37b-385d-4f02-a35e-4a2d31d3c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:41.638860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed37b-385d-4f02-a35e-4a2d31d3c7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:41.639146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed37b-385d-4f02-a35e-4a2d31d3c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:41.639422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed37b-385d-4f02-a35e-4a2d31d3c7b2 admin admin] PATH_INFO: `/v3/users/6a27ca5f05914b5c8e2c141aac84f63f` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:41.657567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bed37b-385d-4f02-a35e-4a2d31d3c7b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=6a27ca5f05914b5c8e2c141aac84f63f)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:41.660220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bed37b-385d-4f02-a35e-4a2d31d3c7b2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:41.661767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 679/1357] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:41 2021] GET /identity/v3/users/6a27ca5f05914b5c8e2c141aac84f63f => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:43.798025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd0dde-2cc8-4bc5-8776-db7111275942 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:43.798638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd0dde-2cc8-4bc5-8776-db7111275942 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:43.798638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd0dde-2cc8-4bc5-8776-db7111275942 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:43.800382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 679/1358] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:43.806040 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc4dde-7c07-4974-938a-4b2bce4ce759 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:43.806676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc4dde-7c07-4974-938a-4b2bce4ce759 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:43.806676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc4dde-7c07-4974-938a-4b2bce4ce759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:43.829189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b9fc4dde-7c07-4974-938a-4b2bce4ce759 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:43.830340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b9fc4dde-7c07-4974-938a-4b2bce4ce759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:43.838122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 680/1359] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:43.860438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd0dde-2cc8-4bc5-8776-db7111275942 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:43.872764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd0dde-2cc8-4bc5-8776-db7111275942 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:43.876922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c93a-a094-45dd-a2e4-164101253ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:43.878200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c93a-a094-45dd-a2e4-164101253ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:43.878518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c93a-a094-45dd-a2e4-164101253ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:43.878803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c93a-a094-45dd-a2e4-164101253ad8 admin admin] PATH_INFO: `/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:43.890551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4c93a-a094-45dd-a2e4-164101253ad8 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1f9d2579dd34d1e93b70d9b69e00f17)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:43.892615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4c93a-a094-45dd-a2e4-164101253ad8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:43.894748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 680/1360] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:50:43 2021] GET /identity/v3/projects/d1f9d2579dd34d1e93b70d9b69e00f17 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:43.900806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc4dde-7c07-4974-938a-4b2bce4ce759 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:43.909700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc4dde-7c07-4974-938a-4b2bce4ce759 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:43.915738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:43.916314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:43.916598 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:43.916901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:43.917617 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] RBAC: Adding query filter params (scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:50:43.917907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:43.919771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:43.927103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 681/1361] 10.222.0.57 () {56 vars in 1231 bytes} [Mon Oct 25 14:50:43 2021] GET /identity/v3/role_assignments?scope.project.id=d1f9d2579dd34d1e93b70d9b69e00f17 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:50:43.933098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c93a-a094-45dd-a2e4-164101253ad8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:43.943162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c93a-a094-45dd-a2e4-164101253ad8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:43.947873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752ab5e-aefa-4e27-8f98-947594d50e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:43.948663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752ab5e-aefa-4e27-8f98-947594d50e23 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:43.948949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752ab5e-aefa-4e27-8f98-947594d50e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:43.949230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752ab5e-aefa-4e27-8f98-947594d50e23 admin admin] PATH_INFO: `/v3/users/de30de5e8c334cc2969552ddec56a508` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:43.967464 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752ab5e-aefa-4e27-8f98-947594d50e23 admin admin] RBAC: Authorizing `identity:get_user(user_id=de30de5e8c334cc2969552ddec56a508)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:43.969575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752ab5e-aefa-4e27-8f98-947594d50e23 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:43.971138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 681/1362] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:43 2021] GET /identity/v3/users/de30de5e8c334cc2969552ddec56a508 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:43.977097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:43.987572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652204d-0384-46a5-b96c-8ac931c6eab2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:43.991767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c55c-0ea7-4c88-a59b-dfb4d67d2d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:43.992555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c55c-0ea7-4c88-a59b-dfb4d67d2d1e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:43.992838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c55c-0ea7-4c88-a59b-dfb4d67d2d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:43.993119 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c55c-0ea7-4c88-a59b-dfb4d67d2d1e admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:43.994225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c55c-0ea7-4c88-a59b-dfb4d67d2d1e admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:43.996044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c55c-0ea7-4c88-a59b-dfb4d67d2d1e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:43.997542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 682/1363] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:43 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:46.172172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48f66-be6c-4bcc-82d5-5a28bf613ac7 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:46.172684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48f66-be6c-4bcc-82d5-5a28bf613ac7 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:46.172684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48f66-be6c-4bcc-82d5-5a28bf613ac7 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:46.174905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 682/1364] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:46.180455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679c5b-e893-4cff-b56b-d6c2d07379ba None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:46.180882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679c5b-e893-4cff-b56b-d6c2d07379ba None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:46.181043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679c5b-e893-4cff-b56b-d6c2d07379ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:46.203449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2d679c5b-e893-4cff-b56b-d6c2d07379ba None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:46.204586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2d679c5b-e893-4cff-b56b-d6c2d07379ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:46.211722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 683/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:46.233441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af48f66-be6c-4bcc-82d5-5a28bf613ac7 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:46.246065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af48f66-be6c-4bcc-82d5-5a28bf613ac7 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:46.250473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32472e7-d190-45fd-87a6-428d1a78cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:46.251280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32472e7-d190-45fd-87a6-428d1a78cbcc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:46.251566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32472e7-d190-45fd-87a6-428d1a78cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:46.251847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32472e7-d190-45fd-87a6-428d1a78cbcc admin admin] PATH_INFO: `/v3/projects/d2644bd7de5142199f3ef0d06b013971` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:46.264384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32472e7-d190-45fd-87a6-428d1a78cbcc admin admin] RBAC: Authorizing `identity:get_project(project_id=d2644bd7de5142199f3ef0d06b013971)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:46.266443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32472e7-d190-45fd-87a6-428d1a78cbcc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:46.268009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 683/1366] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:50:46 2021] GET /identity/v3/projects/d2644bd7de5142199f3ef0d06b013971 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:46.274506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d679c5b-e893-4cff-b56b-d6c2d07379ba None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:46.283615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d679c5b-e893-4cff-b56b-d6c2d07379ba None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:46.288054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:46.288666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:46.288952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:46.289232 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:46.289944 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] RBAC: Adding query filter params (scope.project.id=d2644bd7de5142199f3ef0d06b013971) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:50:46.290239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:46.292094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:46.299596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 684/1367] 10.222.0.57 () {56 vars in 1231 bytes} [Mon Oct 25 14:50:46 2021] GET /identity/v3/role_assignments?scope.project.id=d2644bd7de5142199f3ef0d06b013971 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:50:46.305662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32472e7-d190-45fd-87a6-428d1a78cbcc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:46.315786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32472e7-d190-45fd-87a6-428d1a78cbcc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:46.320158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e17a-59e3-4ab1-978e-caa6aa9f7dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:46.320951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e17a-59e3-4ab1-978e-caa6aa9f7dcb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:46.321240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e17a-59e3-4ab1-978e-caa6aa9f7dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:46.321521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e17a-59e3-4ab1-978e-caa6aa9f7dcb admin admin] PATH_INFO: `/v3/users/310cb95eeed3469b9dee9e716d096b7b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:46.322687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005e17a-59e3-4ab1-978e-caa6aa9f7dcb admin admin] RBAC: Authorizing `identity:get_user(user_id=310cb95eeed3469b9dee9e716d096b7b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:46.324788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005e17a-59e3-4ab1-978e-caa6aa9f7dcb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:46.326267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 684/1368] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:46 2021] GET /identity/v3/users/310cb95eeed3469b9dee9e716d096b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:46.332290 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:46.341800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acb2c-b75b-4885-8c99-775a15752f92 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:46.346039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a6bad-461f-4ce7-b516-f312c597d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:46.346854 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a6bad-461f-4ce7-b516-f312c597d3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:46.347138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a6bad-461f-4ce7-b516-f312c597d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:46.347412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a6bad-461f-4ce7-b516-f312c597d3e5 admin admin] PATH_INFO: `/v3/users/c3aab5572b2c402b81621b54bfffba2e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:46.348491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a6bad-461f-4ce7-b516-f312c597d3e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=c3aab5572b2c402b81621b54bfffba2e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:46.350271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a6bad-461f-4ce7-b516-f312c597d3e5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:46.351760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 685/1369] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:46 2021] GET /identity/v3/users/c3aab5572b2c402b81621b54bfffba2e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:48.539590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abda3-f33f-4a65-bd80-dc38591c05a3 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:48.540177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abda3-f33f-4a65-bd80-dc38591c05a3 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:48.540177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abda3-f33f-4a65-bd80-dc38591c05a3 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:48.541824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 685/1370] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:50:48.547422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a9d7-9b95-4413-8182-b03dd0503ca5 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:48.547854 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a9d7-9b95-4413-8182-b03dd0503ca5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:48.548076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a9d7-9b95-4413-8182-b03dd0503ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:48.570518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7c41a9d7-9b95-4413-8182-b03dd0503ca5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:48.571703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7c41a9d7-9b95-4413-8182-b03dd0503ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:48.580018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 686/1371] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:48.603291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4abda3-f33f-4a65-bd80-dc38591c05a3 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:48.616599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4abda3-f33f-4a65-bd80-dc38591c05a3 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:48.620965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d125f-0922-4af9-b024-c52a321391e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:48.621760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d125f-0922-4af9-b024-c52a321391e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:48.622451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d125f-0922-4af9-b024-c52a321391e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:48.622451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d125f-0922-4af9-b024-c52a321391e2 admin admin] PATH_INFO: `/v3/projects/e60040c3d40b41448eaac9c9bb40dc84` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:48.635432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d125f-0922-4af9-b024-c52a321391e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=e60040c3d40b41448eaac9c9bb40dc84)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:48.637488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d125f-0922-4af9-b024-c52a321391e2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:48.639177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 686/1372] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 25 14:50:48 2021] GET /identity/v3/projects/e60040c3d40b41448eaac9c9bb40dc84 => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:48.645704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41a9d7-9b95-4413-8182-b03dd0503ca5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:48.654658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41a9d7-9b95-4413-8182-b03dd0503ca5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:48.659178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:48.659768 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:48.660053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:48.660330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:48.661054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] RBAC: Adding query filter params (scope.project.id=e60040c3d40b41448eaac9c9bb40dc84) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:50:48.661349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:48.663246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:48.670009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 687/1373] 10.222.0.57 () {56 vars in 1231 bytes} [Mon Oct 25 14:50:48 2021] GET /identity/v3/role_assignments?scope.project.id=e60040c3d40b41448eaac9c9bb40dc84 => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:48.676664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d125f-0922-4af9-b024-c52a321391e2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:48.686276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d125f-0922-4af9-b024-c52a321391e2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:48.691256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557d0dc-e4a3-4a82-b896-def7c6244e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:48.692049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d0dc-e4a3-4a82-b896-def7c6244e6c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:48.692330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d0dc-e4a3-4a82-b896-def7c6244e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:48.692606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d0dc-e4a3-4a82-b896-def7c6244e6c admin admin] PATH_INFO: `/v3/users/61aa1524a1474060a047f21c5287fb3e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:48.712368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557d0dc-e4a3-4a82-b896-def7c6244e6c admin admin] RBAC: Authorizing `identity:get_user(user_id=61aa1524a1474060a047f21c5287fb3e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:48.714532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557d0dc-e4a3-4a82-b896-def7c6244e6c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:48.716116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 687/1374] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:48 2021] GET /identity/v3/users/61aa1524a1474060a047f21c5287fb3e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:48.722819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:48.732525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80526a-bf75-4381-8041-05df3e91aa12 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:48.737895 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3078e-e368-4ca7-b3ad-17e5d159560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:48.738745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3078e-e368-4ca7-b3ad-17e5d159560b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:48.739030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3078e-e368-4ca7-b3ad-17e5d159560b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:48.739306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3078e-e368-4ca7-b3ad-17e5d159560b admin admin] PATH_INFO: `/v3/users/d2b7d5248d40416a8d2ba7fde7fe66f7` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:48.761424 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3078e-e368-4ca7-b3ad-17e5d159560b admin admin] RBAC: Authorizing `identity:get_user(user_id=d2b7d5248d40416a8d2ba7fde7fe66f7)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:48.763606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3078e-e368-4ca7-b3ad-17e5d159560b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:48.765257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 688/1375] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 25 14:50:48 2021] GET /identity/v3/users/d2b7d5248d40416a8d2ba7fde7fe66f7 => generated 285 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:50:53.928952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256523-09ae-40d8-aa04-ca81bf9f4ed3 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:53.929559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256523-09ae-40d8-aa04-ca81bf9f4ed3 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:53.929559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256523-09ae-40d8-aa04-ca81bf9f4ed3 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:53.931209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 688/1376] 10.222.0.57 () {54 vars in 918 bytes} [Mon Oct 25 14:50:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:53.936579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41012-adf2-4936-9450-eee779df094e None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:53.937062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41012-adf2-4936-9450-eee779df094e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:53.937252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41012-adf2-4936-9450-eee779df094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:53.959889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f2f41012-adf2-4936-9450-eee779df094e None None] MFA Rules not processed for user `eca65349f42a4b53aa051474cd1c98d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:53.961085 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f2f41012-adf2-4936-9450-eee779df094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:53.968869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 689/1377] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Oct 25 14:50:53 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:53.983462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa5fc-19fa-4520-96db-383c166c0ca9 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:53.984005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa5fc-19fa-4520-96db-383c166c0ca9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:53.984285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa5fc-19fa-4520-96db-383c166c0ca9 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:53.985932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 689/1378] 10.222.0.57 () {54 vars in 918 bytes} [Mon Oct 25 14:50:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:53.991552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9b31c-54ab-4374-9101-b3f7bf782bbf None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:53.991842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9b31c-54ab-4374-9101-b3f7bf782bbf None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:53.992122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9b31c-54ab-4374-9101-b3f7bf782bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:54.014605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2aa9b31c-54ab-4374-9101-b3f7bf782bbf None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:54.015759 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2aa9b31c-54ab-4374-9101-b3f7bf782bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:54.024126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 690/1379] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Oct 25 14:50:53 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:56.483477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a604-9459-4a05-a23b-e52c041adb1b None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:56.484303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a604-9459-4a05-a23b-e52c041adb1b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:56.484303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a604-9459-4a05-a23b-e52c041adb1b None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:56.485952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 690/1380] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:50:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:56.491544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cabc49-043e-4d77-ad6c-9e8542692edb None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:56.492006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cabc49-043e-4d77-ad6c-9e8542692edb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:56.492243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cabc49-043e-4d77-ad6c-9e8542692edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:56.514204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a0cabc49-043e-4d77-ad6c-9e8542692edb None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:56.515362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a0cabc49-043e-4d77-ad6c-9e8542692edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:56.523045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 691/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:50:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:50:56.565241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4a604-9459-4a05-a23b-e52c041adb1b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:56.579575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4a604-9459-4a05-a23b-e52c041adb1b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:56.585327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00492aa-d071-4e7f-abd2-4d3e4645acb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:56.585905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492aa-d071-4e7f-abd2-4d3e4645acb9 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:56.586198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492aa-d071-4e7f-abd2-4d3e4645acb9 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:56.586509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492aa-d071-4e7f-abd2-4d3e4645acb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:56.595048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00492aa-d071-4e7f-abd2-4d3e4645acb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:56.596620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00492aa-d071-4e7f-abd2-4d3e4645acb9 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:56.605649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 691/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:50:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:50:57.999780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89640124-6520-43c3-9645-2258393bf95f None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:58.000339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89640124-6520-43c3-9645-2258393bf95f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:58.000339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89640124-6520-43c3-9645-2258393bf95f None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:58.002658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 692/1383] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:50:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:58.007804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53103f56-8634-4461-a41a-fec12068c13b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:58.008312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53103f56-8634-4461-a41a-fec12068c13b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:58.008518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53103f56-8634-4461-a41a-fec12068c13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:58.031961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-53103f56-8634-4461-a41a-fec12068c13b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:58.033113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-53103f56-8634-4461-a41a-fec12068c13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:58.040953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 692/1384] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:50:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:58.189269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89640124-6520-43c3-9645-2258393bf95f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:58.204459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89640124-6520-43c3-9645-2258393bf95f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:58.209466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0e4de-9df7-461c-a88d-ea703d2f5d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:58.210032 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e4de-9df7-461c-a88d-ea703d2f5d6b service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:58.210317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e4de-9df7-461c-a88d-ea703d2f5d6b service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:58.210619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e4de-9df7-461c-a88d-ea703d2f5d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:58.218467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0e4de-9df7-461c-a88d-ea703d2f5d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:58.220053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0e4de-9df7-461c-a88d-ea703d2f5d6b service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:58.228902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 693/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:50:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:50:59.625776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633396-2108-43cd-8aa7-62fa359d1bac None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:59.626359 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633396-2108-43cd-8aa7-62fa359d1bac None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:59.626359 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633396-2108-43cd-8aa7-62fa359d1bac None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:59.628615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 693/1386] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:50:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:50:59.633749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4175b-6f82-434a-bed5-b4ecdeb706e2 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:59.634225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4175b-6f82-434a-bed5-b4ecdeb706e2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:59.634344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4175b-6f82-434a-bed5-b4ecdeb706e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:59.657745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-13c4175b-6f82-434a-bed5-b4ecdeb706e2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:50:59.658948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-13c4175b-6f82-434a-bed5-b4ecdeb706e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:50:59.666114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 694/1387] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:50:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:50:59.817557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633396-2108-43cd-8aa7-62fa359d1bac None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:50:59.831663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633396-2108-43cd-8aa7-62fa359d1bac None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:50:59.836674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c81c-6822-4f65-b624-de19f113a07c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:50:59.837245 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c81c-6822-4f65-b624-de19f113a07c service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:50:59.837537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c81c-6822-4f65-b624-de19f113a07c service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:50:59.837820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c81c-6822-4f65-b624-de19f113a07c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:50:59.846296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c81c-6822-4f65-b624-de19f113a07c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:50:59.847898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c81c-6822-4f65-b624-de19f113a07c service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:50:59.856932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 694/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:50:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:51:01.259927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e125ec2-bc82-4e33-a348-968f491fad48 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:01.260482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e125ec2-bc82-4e33-a348-968f491fad48 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:01.260482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e125ec2-bc82-4e33-a348-968f491fad48 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:01.262168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 695/1389] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:51:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:01.268347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08e318-2997-4031-832e-319924d8e3b5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:01.268898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08e318-2997-4031-832e-319924d8e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:01.268898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08e318-2997-4031-832e-319924d8e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:01.292099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ed08e318-2997-4031-832e-319924d8e3b5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:01.293258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ed08e318-2997-4031-832e-319924d8e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:01.304679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 695/1390] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:51:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:01.459412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e125ec2-bc82-4e33-a348-968f491fad48 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:01.473559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e125ec2-bc82-4e33-a348-968f491fad48 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:01.478522 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e839c19-bea3-45ff-820c-e9598c3e3cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:01.479103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e839c19-bea3-45ff-820c-e9598c3e3cb8 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:01.479386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e839c19-bea3-45ff-820c-e9598c3e3cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:01.479661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e839c19-bea3-45ff-820c-e9598c3e3cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:01.488762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e839c19-bea3-45ff-820c-e9598c3e3cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:01.490335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e839c19-bea3-45ff-820c-e9598c3e3cb8 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:01.499501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 696/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:02.919843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fd15-7748-4d13-bc92-221a830d4352 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:02.920440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fd15-7748-4d13-bc92-221a830d4352 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:02.920440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fd15-7748-4d13-bc92-221a830d4352 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:02.922090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 696/1392] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:51:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:02.927392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ff75-783e-4ff9-996f-1b7c6be4b511 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:02.927848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ff75-783e-4ff9-996f-1b7c6be4b511 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:02.927955 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ff75-783e-4ff9-996f-1b7c6be4b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:02.950112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5e78ff75-783e-4ff9-996f-1b7c6be4b511 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:02.951297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5e78ff75-783e-4ff9-996f-1b7c6be4b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:02.959012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 697/1393] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:51:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:03.110008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296fd15-7748-4d13-bc92-221a830d4352 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:03.123475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296fd15-7748-4d13-bc92-221a830d4352 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:03.128992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b850d6-f207-45f3-a51a-a28c7e201899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:03.129613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b850d6-f207-45f3-a51a-a28c7e201899 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:03.129905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b850d6-f207-45f3-a51a-a28c7e201899 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:03.130187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b850d6-f207-45f3-a51a-a28c7e201899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:03.138232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b850d6-f207-45f3-a51a-a28c7e201899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:03.139835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b850d6-f207-45f3-a51a-a28c7e201899 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:03.149459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 697/1394] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:51:04.497279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fb00e-fcb9-4260-bfa3-97c8105aa407 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:04.497858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fb00e-fcb9-4260-bfa3-97c8105aa407 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:04.497858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fb00e-fcb9-4260-bfa3-97c8105aa407 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:04.499552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 698/1395] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:51:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:04.504856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b5bc-defc-4d2b-a23b-08b4be78d310 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:04.505340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b5bc-defc-4d2b-a23b-08b4be78d310 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:04.505448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b5bc-defc-4d2b-a23b-08b4be78d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:04.528335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a285b5bc-defc-4d2b-a23b-08b4be78d310 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:04.529486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a285b5bc-defc-4d2b-a23b-08b4be78d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:04.537467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 698/1396] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:51:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:51:04.689661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fb00e-fcb9-4260-bfa3-97c8105aa407 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:04.704077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fb00e-fcb9-4260-bfa3-97c8105aa407 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:04.709939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8c0fd-9958-4861-8e3e-fd11f891089f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:04.710533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8c0fd-9958-4861-8e3e-fd11f891089f service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:04.710823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8c0fd-9958-4861-8e3e-fd11f891089f service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:04.711104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8c0fd-9958-4861-8e3e-fd11f891089f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:04.719885 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8c0fd-9958-4861-8e3e-fd11f891089f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:04.721699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8c0fd-9958-4861-8e3e-fd11f891089f service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:04.731123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 699/1397] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:06.062759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2a11-6066-4bda-b434-efc15fd28156 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:06.063325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2a11-6066-4bda-b434-efc15fd28156 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:06.063325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2a11-6066-4bda-b434-efc15fd28156 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:06.065713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 699/1398] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:51:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:06.070779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b66f9-bc7b-4e93-9eca-2781401f9cfd None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:06.071189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b66f9-bc7b-4e93-9eca-2781401f9cfd None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:06.071379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b66f9-bc7b-4e93-9eca-2781401f9cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:06.093791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-ac5b66f9-bc7b-4e93-9eca-2781401f9cfd None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:06.094943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ac5b66f9-bc7b-4e93-9eca-2781401f9cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:06.102434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 700/1399] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:51:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:06.251117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e2a11-6066-4bda-b434-efc15fd28156 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:06.265174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e2a11-6066-4bda-b434-efc15fd28156 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:06.271127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674846b-4cf1-4ce8-8706-154c485562ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:06.271696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674846b-4cf1-4ce8-8706-154c485562ca service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:06.272011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674846b-4cf1-4ce8-8706-154c485562ca service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:06.272292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674846b-4cf1-4ce8-8706-154c485562ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:06.280472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674846b-4cf1-4ce8-8706-154c485562ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:06.282032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674846b-4cf1-4ce8-8706-154c485562ca service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:06.290983 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 700/1400] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:07.603252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d33f9b-ce0d-44ce-89ef-647fab10aed9 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:07.603803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d33f9b-ce0d-44ce-89ef-647fab10aed9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:07.603900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d33f9b-ce0d-44ce-89ef-647fab10aed9 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:07.605512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 701/1401] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:51:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:07.610707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c972e40-24c9-42ac-85b9-1fd66c7a5651 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:07.611171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c972e40-24c9-42ac-85b9-1fd66c7a5651 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:07.611317 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c972e40-24c9-42ac-85b9-1fd66c7a5651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:07.633654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8c972e40-24c9-42ac-85b9-1fd66c7a5651 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:07.634837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8c972e40-24c9-42ac-85b9-1fd66c7a5651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:07.642070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 701/1402] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:51:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:07.794494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d33f9b-ce0d-44ce-89ef-647fab10aed9 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:07.809295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d33f9b-ce0d-44ce-89ef-647fab10aed9 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:07.814354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f57295-8ab3-4592-ae67-40e79bed79e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:07.814960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57295-8ab3-4592-ae67-40e79bed79e7 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:07.815246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57295-8ab3-4592-ae67-40e79bed79e7 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:07.815559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57295-8ab3-4592-ae67-40e79bed79e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:07.824029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f57295-8ab3-4592-ae67-40e79bed79e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:07.825611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f57295-8ab3-4592-ae67-40e79bed79e7 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:07.834863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 702/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:09.163901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d13ca-8a59-44b3-a76a-6eb86ed9f3d8 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:09.164450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d13ca-8a59-44b3-a76a-6eb86ed9f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:09.164450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d13ca-8a59-44b3-a76a-6eb86ed9f3d8 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:09.166150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 702/1404] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:51:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:09.171269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614f3b-7dad-4c55-a7aa-59582a5ee39c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:09.171700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614f3b-7dad-4c55-a7aa-59582a5ee39c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:09.171814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614f3b-7dad-4c55-a7aa-59582a5ee39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:09.194431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-23614f3b-7dad-4c55-a7aa-59582a5ee39c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:09.195568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-23614f3b-7dad-4c55-a7aa-59582a5ee39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:09.202673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 703/1405] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:51:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:09.353479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d13ca-8a59-44b3-a76a-6eb86ed9f3d8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:09.367153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d13ca-8a59-44b3-a76a-6eb86ed9f3d8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:09.372151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105a66a-8daa-4eaf-bf7b-c6b75769b3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:09.372713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105a66a-8daa-4eaf-bf7b-c6b75769b3de service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:09.373000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105a66a-8daa-4eaf-bf7b-c6b75769b3de service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:09.373280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105a66a-8daa-4eaf-bf7b-c6b75769b3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:09.381884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105a66a-8daa-4eaf-bf7b-c6b75769b3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:09.383483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105a66a-8daa-4eaf-bf7b-c6b75769b3de service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:09.393231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 703/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:11.440631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9113c9-0e95-499e-b104-d6d3135f1686 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:11.441204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9113c9-0e95-499e-b104-d6d3135f1686 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:11.441204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9113c9-0e95-499e-b104-d6d3135f1686 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:11.442936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 704/1407] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:11.448387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48a854-6f39-466a-975c-1d82e2739389 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:11.448850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48a854-6f39-466a-975c-1d82e2739389 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:11.448944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48a854-6f39-466a-975c-1d82e2739389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:11.471208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-bd48a854-6f39-466a-975c-1d82e2739389 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:11.472351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bd48a854-6f39-466a-975c-1d82e2739389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:11.479475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 704/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:11.518458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9113c9-0e95-499e-b104-d6d3135f1686 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:11.528853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9113c9-0e95-499e-b104-d6d3135f1686 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:11.532192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da70ae4-ea72-4835-8f0c-80bfaef7cdf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:11.532791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da70ae4-ea72-4835-8f0c-80bfaef7cdf7 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:11.533076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da70ae4-ea72-4835-8f0c-80bfaef7cdf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:11.533355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da70ae4-ea72-4835-8f0c-80bfaef7cdf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:11.541984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da70ae4-ea72-4835-8f0c-80bfaef7cdf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:11.543436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da70ae4-ea72-4835-8f0c-80bfaef7cdf7 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:11.552290 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 705/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:13.818366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0611-149f-4643-84fa-38598f92588f None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:13.818923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0611-149f-4643-84fa-38598f92588f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:13.819303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0611-149f-4643-84fa-38598f92588f None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:13.821202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 705/1410] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:13.826750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807a1c0-83bd-4f7b-a773-7686e417fe1a None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:13.827203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807a1c0-83bd-4f7b-a773-7686e417fe1a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:13.827306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807a1c0-83bd-4f7b-a773-7686e417fe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:13.850122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7807a1c0-83bd-4f7b-a773-7686e417fe1a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:13.851291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7807a1c0-83bd-4f7b-a773-7686e417fe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:13.858443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 706/1411] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:13.896818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f0611-149f-4643-84fa-38598f92588f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:13.898479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-542f0611-149f-4643-84fa-38598f92588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:13.911414 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f0611-149f-4643-84fa-38598f92588f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:13.914872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f45cf-afdc-4e2a-84f2-c5d128fe4931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:13.915446 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f45cf-afdc-4e2a-84f2-c5d128fe4931 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:13.915732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f45cf-afdc-4e2a-84f2-c5d128fe4931 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:13.916011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f45cf-afdc-4e2a-84f2-c5d128fe4931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:13.925747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f45cf-afdc-4e2a-84f2-c5d128fe4931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:13.927201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f45cf-afdc-4e2a-84f2-c5d128fe4931 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:13.936352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 706/1412] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:16.497145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f5f3-2147-461a-84d9-30edb8d4c81b None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:16.497687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f5f3-2147-461a-84d9-30edb8d4c81b None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:16.497813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f5f3-2147-461a-84d9-30edb8d4c81b None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:16.499462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 707/1413] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:16.504761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f2bcd-c2f9-46c0-a5b0-e072094692ac None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:16.505203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f2bcd-c2f9-46c0-a5b0-e072094692ac None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:16.505404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f2bcd-c2f9-46c0-a5b0-e072094692ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:16.528159 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-2c3f2bcd-c2f9-46c0-a5b0-e072094692ac None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:16.529307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2c3f2bcd-c2f9-46c0-a5b0-e072094692ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:16.537319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 707/1414] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:16.577007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0f5f3-2147-461a-84d9-30edb8d4c81b None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:16.588801 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0f5f3-2147-461a-84d9-30edb8d4c81b None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:16.594422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dc84b-2c1d-4e80-baab-16852fe98bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:16.595573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc84b-2c1d-4e80-baab-16852fe98bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:16.595893 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc84b-2c1d-4e80-baab-16852fe98bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:16.596238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc84b-2c1d-4e80-baab-16852fe98bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:16.605554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dc84b-2c1d-4e80-baab-16852fe98bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:16.607055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dc84b-2c1d-4e80-baab-16852fe98bb1 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:16.616429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 708/1415] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:18.835323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444589-ac1b-470c-b77b-4cc212ed9d63 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:18.835945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444589-ac1b-470c-b77b-4cc212ed9d63 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:18.835945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444589-ac1b-470c-b77b-4cc212ed9d63 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:18.837555 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 708/1416] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:18.843167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbad0b-e10c-43a4-aa6f-2e8001313b49 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:18.843936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbad0b-e10c-43a4-aa6f-2e8001313b49 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:18.844221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbad0b-e10c-43a4-aa6f-2e8001313b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:18.867305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5ecbad0b-e10c-43a4-aa6f-2e8001313b49 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:18.868450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5ecbad0b-e10c-43a4-aa6f-2e8001313b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:18.876069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 709/1417] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:18.916232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9444589-ac1b-470c-b77b-4cc212ed9d63 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:18.927629 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9444589-ac1b-470c-b77b-4cc212ed9d63 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:18.931028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd8c4-cb16-47b7-89fd-bb9f60cd8840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:18.931626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd8c4-cb16-47b7-89fd-bb9f60cd8840 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:18.931931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd8c4-cb16-47b7-89fd-bb9f60cd8840 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:18.932195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd8c4-cb16-47b7-89fd-bb9f60cd8840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:18.940975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd8c4-cb16-47b7-89fd-bb9f60cd8840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:18.942429 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd8c4-cb16-47b7-89fd-bb9f60cd8840 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:18.951403 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 709/1418] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:21.187825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d11f-7f6d-496a-9a63-03373a21e636 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:21.188417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d11f-7f6d-496a-9a63-03373a21e636 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:21.188417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d11f-7f6d-496a-9a63-03373a21e636 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:21.190036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 710/1419] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:21.195768 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15407-c9e7-47b8-9e71-86f1bf498c74 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:21.196229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15407-c9e7-47b8-9e71-86f1bf498c74 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:21.196405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15407-c9e7-47b8-9e71-86f1bf498c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:21.219461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-83d15407-c9e7-47b8-9e71-86f1bf498c74 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:21.221255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-83d15407-c9e7-47b8-9e71-86f1bf498c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:21.228292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 710/1420] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:21.268589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6d11f-7f6d-496a-9a63-03373a21e636 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:21.279137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6d11f-7f6d-496a-9a63-03373a21e636 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:21.283031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad9039-8363-4c91-bea9-bd3b3781539a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:21.283592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad9039-8363-4c91-bea9-bd3b3781539a service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:21.283883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad9039-8363-4c91-bea9-bd3b3781539a service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:21.284158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad9039-8363-4c91-bea9-bd3b3781539a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:21.292780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad9039-8363-4c91-bea9-bd3b3781539a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:21.294203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad9039-8363-4c91-bea9-bd3b3781539a service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:21.303690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 711/1421] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:23.526883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe09db-f6fc-4785-a731-7169da8a6163 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:23.527496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe09db-f6fc-4785-a731-7169da8a6163 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:23.527496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe09db-f6fc-4785-a731-7169da8a6163 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:23.529101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 711/1422] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:23.534949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9264b-4284-4445-b306-90ccfe62489c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:23.535408 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9264b-4284-4445-b306-90ccfe62489c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:23.535504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9264b-4284-4445-b306-90ccfe62489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:23.557850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b4a9264b-4284-4445-b306-90ccfe62489c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:23.559024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b4a9264b-4284-4445-b306-90ccfe62489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:23.566755 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 712/1423] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:23.605222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe09db-f6fc-4785-a731-7169da8a6163 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:23.616355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe09db-f6fc-4785-a731-7169da8a6163 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:23.619787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c9e78-7ef6-4b5c-8fa4-fe1fb7accbdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:23.620348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9e78-7ef6-4b5c-8fa4-fe1fb7accbdc service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:23.620635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9e78-7ef6-4b5c-8fa4-fe1fb7accbdc service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:23.620945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9e78-7ef6-4b5c-8fa4-fe1fb7accbdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:23.630226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c9e78-7ef6-4b5c-8fa4-fe1fb7accbdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:23.631692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c9e78-7ef6-4b5c-8fa4-fe1fb7accbdc service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:23.640756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 712/1424] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:25.857887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954391-8bee-457f-8c6e-04db3795880a None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:25.858359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954391-8bee-457f-8c6e-04db3795880a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:25.858471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954391-8bee-457f-8c6e-04db3795880a None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:25.861107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 713/1425] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:25.867369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3223f7-65f9-4cfe-8bc3-a795295eb3af None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:25.867905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3223f7-65f9-4cfe-8bc3-a795295eb3af None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:25.868347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3223f7-65f9-4cfe-8bc3-a795295eb3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:25.890594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4b3223f7-65f9-4cfe-8bc3-a795295eb3af None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:25.891778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4b3223f7-65f9-4cfe-8bc3-a795295eb3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:25.898767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 713/1426] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:25.936881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5954391-8bee-457f-8c6e-04db3795880a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:25.947479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5954391-8bee-457f-8c6e-04db3795880a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:25.950906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8cc9-d92c-4d08-954e-6a752b6149cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:25.951475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8cc9-d92c-4d08-954e-6a752b6149cb service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:25.951764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8cc9-d92c-4d08-954e-6a752b6149cb service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:25.952045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8cc9-d92c-4d08-954e-6a752b6149cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:25.961352 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8cc9-d92c-4d08-954e-6a752b6149cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:25.962837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8cc9-d92c-4d08-954e-6a752b6149cb service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:25.972692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 714/1427] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:28.110741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f9cb-9eaa-4c45-a66c-fb1f40dd13ef None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:28.111267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f9cb-9eaa-4c45-a66c-fb1f40dd13ef None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:28.111267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f9cb-9eaa-4c45-a66c-fb1f40dd13ef None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:28.113081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 714/1428] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:28.118992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d545-48bd-4bd8-a139-c3be8e4bb54a None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:28.119541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d545-48bd-4bd8-a139-c3be8e4bb54a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:28.119541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d545-48bd-4bd8-a139-c3be8e4bb54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:28.142117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-58f1d545-48bd-4bd8-a139-c3be8e4bb54a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:28.143275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-58f1d545-48bd-4bd8-a139-c3be8e4bb54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:28.150294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 715/1429] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:28.189895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050f9cb-9eaa-4c45-a66c-fb1f40dd13ef None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:28.200312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050f9cb-9eaa-4c45-a66c-fb1f40dd13ef None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:28.203668 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f417f9-7100-41cf-be09-19a32f3c09d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:28.204250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f417f9-7100-41cf-be09-19a32f3c09d1 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:28.204535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f417f9-7100-41cf-be09-19a32f3c09d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:28.204814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f417f9-7100-41cf-be09-19a32f3c09d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:28.213510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f417f9-7100-41cf-be09-19a32f3c09d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:28.214955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f417f9-7100-41cf-be09-19a32f3c09d1 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:28.223927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 715/1430] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:30.367753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7762-4837-49eb-b02e-fd27e1e4d6d8 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:30.368315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7762-4837-49eb-b02e-fd27e1e4d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:30.368315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7762-4837-49eb-b02e-fd27e1e4d6d8 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:30.370008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 716/1431] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:30.375366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37433-e0c3-40b9-99ac-aeda3d28c717 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:30.376285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37433-e0c3-40b9-99ac-aeda3d28c717 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:30.376427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37433-e0c3-40b9-99ac-aeda3d28c717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:30.398920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-28f37433-e0c3-40b9-99ac-aeda3d28c717 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:30.400060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-28f37433-e0c3-40b9-99ac-aeda3d28c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:30.407637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 716/1432] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:30.445807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7762-4837-49eb-b02e-fd27e1e4d6d8 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:30.456299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7762-4837-49eb-b02e-fd27e1e4d6d8 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:30.459623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa6cf1-c8ac-4585-8374-5e79cb1b4ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:30.460190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa6cf1-c8ac-4585-8374-5e79cb1b4ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:30.460472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa6cf1-c8ac-4585-8374-5e79cb1b4ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:30.460748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa6cf1-c8ac-4585-8374-5e79cb1b4ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:30.469251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa6cf1-c8ac-4585-8374-5e79cb1b4ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:30.470697 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa6cf1-c8ac-4585-8374-5e79cb1b4ef4 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:30.479555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 717/1433] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:32.613743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d528de-db63-4052-9e78-a7aacae970b6 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:32.614323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d528de-db63-4052-9e78-a7aacae970b6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:32.614323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d528de-db63-4052-9e78-a7aacae970b6 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:32.616045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 717/1434] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:32.622138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbf59a-3394-4cc3-8d2a-461011745c3e None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:32.622729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbf59a-3394-4cc3-8d2a-461011745c3e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:32.622729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbf59a-3394-4cc3-8d2a-461011745c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:32.647516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-60dbf59a-3394-4cc3-8d2a-461011745c3e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:32.648672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-60dbf59a-3394-4cc3-8d2a-461011745c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:32.656134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 718/1435] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:32.694569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d528de-db63-4052-9e78-a7aacae970b6 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:32.706654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d528de-db63-4052-9e78-a7aacae970b6 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:32.709987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885af9-8d9d-429a-a0b6-ba029b171215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:32.710599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885af9-8d9d-429a-a0b6-ba029b171215 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:32.710897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885af9-8d9d-429a-a0b6-ba029b171215 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:32.711174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885af9-8d9d-429a-a0b6-ba029b171215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:32.720851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd885af9-8d9d-429a-a0b6-ba029b171215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:32.722273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd885af9-8d9d-429a-a0b6-ba029b171215 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:32.731405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 718/1436] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:49.518468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5779-f898-46dc-a826-f042ff1a536b None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:49.519067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5779-f898-46dc-a826-f042ff1a536b None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:49.519067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5779-f898-46dc-a826-f042ff1a536b None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:49.520730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 719/1437] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:49.526111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ed41-853b-48ef-9ecc-1507b64c3b2d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:49.526551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ed41-853b-48ef-9ecc-1507b64c3b2d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:49.526718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ed41-853b-48ef-9ecc-1507b64c3b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:49.549121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-b2c5ed41-853b-48ef-9ecc-1507b64c3b2d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:49.550348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b2c5ed41-853b-48ef-9ecc-1507b64c3b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:49.557629 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 719/1438] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:49.605134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0f55e-a5f4-4b07-b868-11f485f59371 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:49.605422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0f55e-a5f4-4b07-b868-11f485f59371 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:49.605701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0f55e-a5f4-4b07-b868-11f485f59371 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:49.607394 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 720/1439] 10.222.0.57 () {54 vars in 956 bytes} [Mon Oct 25 14:51:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:49.612926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289de21e-fad2-40e7-95f5-c00780e43431 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:49.613221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289de21e-fad2-40e7-95f5-c00780e43431 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:49.613508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289de21e-fad2-40e7-95f5-c00780e43431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:49.635589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-289de21e-fad2-40e7-95f5-c00780e43431 None None] MFA Rules not processed for user `c92f456ee8cf4564aaca2b16f320b49d`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:49.636733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-289de21e-fad2-40e7-95f5-c00780e43431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:49.643207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 720/1440] 10.222.0.57 () {58 vars in 1053 bytes} [Mon Oct 25 14:51:49 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:49.650655 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0f55e-a5f4-4b07-b868-11f485f59371 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:49.661686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0f55e-a5f4-4b07-b868-11f485f59371 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:49.664982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863952b5-7ff9-4ce5-9f12-789e107fb30c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92f456ee8cf4564aaca2b16f320b49d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:49.665545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863952b5-7ff9-4ce5-9f12-789e107fb30c service glance] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:49.665828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863952b5-7ff9-4ce5-9f12-789e107fb30c service glance] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:49.666101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863952b5-7ff9-4ce5-9f12-789e107fb30c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:49.675978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863952b5-7ff9-4ce5-9f12-789e107fb30c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:49.677393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863952b5-7ff9-4ce5-9f12-789e107fb30c service glance] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:49.686712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 721/1441] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:51.885022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f3d74-ff9b-48a5-813f-f6d6de19b4e1 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:51.885635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f3d74-ff9b-48a5-813f-f6d6de19b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:51.885635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f3d74-ff9b-48a5-813f-f6d6de19b4e1 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:51.887307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 721/1442] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:51.892546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9044ff-b6bc-48d4-9778-da8bfd9664f3 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:51.893029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9044ff-b6bc-48d4-9778-da8bfd9664f3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:51.893136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9044ff-b6bc-48d4-9778-da8bfd9664f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:51.914763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7c9044ff-b6bc-48d4-9778-da8bfd9664f3 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:51.915904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7c9044ff-b6bc-48d4-9778-da8bfd9664f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:51.923841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 722/1443] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:51.947290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f3d74-ff9b-48a5-813f-f6d6de19b4e1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:51.959360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f3d74-ff9b-48a5-813f-f6d6de19b4e1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:51.963550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf94f8-2e46-4303-a67f-4c611c70f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:51.964120 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf94f8-2e46-4303-a67f-4c611c70f286 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:51.964403 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf94f8-2e46-4303-a67f-4c611c70f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:51.964678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf94f8-2e46-4303-a67f-4c611c70f286 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:51.965365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf94f8-2e46-4303-a67f-4c611c70f286 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:51.967235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf94f8-2e46-4303-a67f-4c611c70f286 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:51.982373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 722/1444] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 25 14:51:51 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:51:53.500585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1fbc-f62a-4c39-8ff0-b98bdf05cd73 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:53.501218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1fbc-f62a-4c39-8ff0-b98bdf05cd73 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:53.501218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1fbc-f62a-4c39-8ff0-b98bdf05cd73 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:53.502907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 723/1445] 10.222.0.57 () {54 vars in 911 bytes} [Mon Oct 25 14:51:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:53.507896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb7cee-adc9-4a7e-8e03-890db17e547d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:53.508382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb7cee-adc9-4a7e-8e03-890db17e547d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:53.508504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb7cee-adc9-4a7e-8e03-890db17e547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:53.530764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-bbbb7cee-adc9-4a7e-8e03-890db17e547d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:53.532481 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bbbb7cee-adc9-4a7e-8e03-890db17e547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:53.539637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 723/1446] 10.222.0.57 () {58 vars in 1008 bytes} [Mon Oct 25 14:51:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:53.690270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f1fbc-f62a-4c39-8ff0-b98bdf05cd73 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:53.704277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f1fbc-f62a-4c39-8ff0-b98bdf05cd73 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:53.709555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e090246-ecf1-4e00-b9fd-6a8c8b37e22a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:53.710135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090246-ecf1-4e00-b9fd-6a8c8b37e22a service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:53.710482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090246-ecf1-4e00-b9fd-6a8c8b37e22a service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:53.710769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090246-ecf1-4e00-b9fd-6a8c8b37e22a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:53.719501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e090246-ecf1-4e00-b9fd-6a8c8b37e22a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:53.721159 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e090246-ecf1-4e00-b9fd-6a8c8b37e22a service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:53.730148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 724/1447] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:55.853037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ddce-435f-4301-a742-bdbc58cf35cc None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:55.853644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ddce-435f-4301-a742-bdbc58cf35cc None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:55.853644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ddce-435f-4301-a742-bdbc58cf35cc None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:55.855350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 724/1448] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:55.861972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccb83-c7a4-4a25-b2a4-9ddb298dd60a None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:55.862544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccb83-c7a4-4a25-b2a4-9ddb298dd60a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:55.862686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccb83-c7a4-4a25-b2a4-9ddb298dd60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:55.885472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-133ccb83-c7a4-4a25-b2a4-9ddb298dd60a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:55.886574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-133ccb83-c7a4-4a25-b2a4-9ddb298dd60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:55.893786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 725/1449] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:55.930097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ddce-435f-4301-a742-bdbc58cf35cc None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:55.941347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ddce-435f-4301-a742-bdbc58cf35cc None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:55.944651 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132f0fa-5216-4d47-8412-709b6f94ee42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:55.945225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f0fa-5216-4d47-8412-709b6f94ee42 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:55.945509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f0fa-5216-4d47-8412-709b6f94ee42 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:55.945786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f0fa-5216-4d47-8412-709b6f94ee42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:55.954680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132f0fa-5216-4d47-8412-709b6f94ee42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:55.956096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132f0fa-5216-4d47-8412-709b6f94ee42 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:55.965023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 725/1450] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:51:58.138199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb618b-e293-4cbe-b160-211551bad15f None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:58.138756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb618b-e293-4cbe-b160-211551bad15f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:58.138756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb618b-e293-4cbe-b160-211551bad15f None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:58.140943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 726/1451] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:51:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:51:58.146274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e86cc-0e47-43d8-b3cf-454408812a8d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:58.146772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e86cc-0e47-43d8-b3cf-454408812a8d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:58.146878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e86cc-0e47-43d8-b3cf-454408812a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:58.169207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-107e86cc-0e47-43d8-b3cf-454408812a8d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:51:58.170352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-107e86cc-0e47-43d8-b3cf-454408812a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:51:58.177498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 726/1452] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:51:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:51:58.217914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb618b-e293-4cbe-b160-211551bad15f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:51:58.229046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb618b-e293-4cbe-b160-211551bad15f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:51:58.232549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bb837-09b0-4831-ac60-a40239907c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:51:58.233117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bb837-09b0-4831-ac60-a40239907c2f service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:51:58.233406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bb837-09b0-4831-ac60-a40239907c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:51:58.233944 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bb837-09b0-4831-ac60-a40239907c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:51:58.242988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bb837-09b0-4831-ac60-a40239907c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:51:58.244415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bb837-09b0-4831-ac60-a40239907c2f service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:51:58.254138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 727/1453] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:51:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:52:00.501232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab697-3006-410f-a780-0668e9ba42be None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:52:00.501807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab697-3006-410f-a780-0668e9ba42be None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:52:00.501807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab697-3006-410f-a780-0668e9ba42be None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:52:00.503504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 727/1454] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:52:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:52:00.508758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f9bf-2019-46fe-883e-e440e0098aea None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:52:00.509217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f9bf-2019-46fe-883e-e440e0098aea None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:52:00.509322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f9bf-2019-46fe-883e-e440e0098aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:52:00.531421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2cf5f9bf-2019-46fe-883e-e440e0098aea None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:52:00.532563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2cf5f9bf-2019-46fe-883e-e440e0098aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:52:00.539748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 728/1455] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:52:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:52:00.580182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab697-3006-410f-a780-0668e9ba42be None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:52:00.591197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab697-3006-410f-a780-0668e9ba42be None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:52:00.594681 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b35d83-9feb-42a0-a655-b91324dc9601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:52:00.595252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35d83-9feb-42a0-a655-b91324dc9601 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:52:00.595540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35d83-9feb-42a0-a655-b91324dc9601 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:52:00.595824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b35d83-9feb-42a0-a655-b91324dc9601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:52:00.604762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b35d83-9feb-42a0-a655-b91324dc9601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:52:00.606186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b35d83-9feb-42a0-a655-b91324dc9601 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:52:00.616080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 728/1456] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:52:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:52:03.091641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663d09-9b8f-46f0-ba4c-36f5ba4d6950 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:52:03.092231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663d09-9b8f-46f0-ba4c-36f5ba4d6950 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:52:03.092231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663d09-9b8f-46f0-ba4c-36f5ba4d6950 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:52:03.093936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 729/1457] 10.222.0.57 () {54 vars in 926 bytes} [Mon Oct 25 14:52:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:52:03.099737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b816e90-6454-41bc-abb2-1076985beae1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:52:03.100269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b816e90-6454-41bc-abb2-1076985beae1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:52:03.100269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b816e90-6454-41bc-abb2-1076985beae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:52:03.123674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-2b816e90-6454-41bc-abb2-1076985beae1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:52:03.125611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2b816e90-6454-41bc-abb2-1076985beae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:52:03.135874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 729/1458] 10.222.0.57 () {58 vars in 1023 bytes} [Mon Oct 25 14:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:52:03.176094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38663d09-9b8f-46f0-ba4c-36f5ba4d6950 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:52:03.188141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38663d09-9b8f-46f0-ba4c-36f5ba4d6950 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:52:03.191571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51724e-aa31-4a8f-b77f-f7dccb1d3de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:52:03.192166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51724e-aa31-4a8f-b77f-f7dccb1d3de7 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:52:03.192452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51724e-aa31-4a8f-b77f-f7dccb1d3de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:52:03.192732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51724e-aa31-4a8f-b77f-f7dccb1d3de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:52:03.203873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51724e-aa31-4a8f-b77f-f7dccb1d3de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:52:03.205130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51724e-aa31-4a8f-b77f-f7dccb1d3de7 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:52:03.215484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 730/1459] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:52:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:53:21.129064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3097-e61c-4c76-b660-b0fd57c2d7b9 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.129673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3097-e61c-4c76-b660-b0fd57c2d7b9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.129673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3097-e61c-4c76-b660-b0fd57c2d7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.152594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-355a3097-e61c-4c76-b660-b0fd57c2d7b9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:53:21.153780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-355a3097-e61c-4c76-b660-b0fd57c2d7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:53:21.161339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 730/1460] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:53:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:53:21.170145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816cc53-b3db-498b-877b-1e170231b2df None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.170780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816cc53-b3db-498b-877b-1e170231b2df None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.170780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816cc53-b3db-498b-877b-1e170231b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.194994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2816cc53-b3db-498b-877b-1e170231b2df None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:53:21.196158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2816cc53-b3db-498b-877b-1e170231b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:53:21.204077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 731/1461] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:53:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:53:21.208861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3097-e61c-4c76-b660-b0fd57c2d7b9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:21.218620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3097-e61c-4c76-b660-b0fd57c2d7b9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:21.223064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:21.223674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.223965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.224250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.224959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:53:21.225260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:21.226903 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:21.241276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 731/1462] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:53:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:53:21.250297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816cc53-b3db-498b-877b-1e170231b2df None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:21.259523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816cc53-b3db-498b-877b-1e170231b2df None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:21.264191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff5957-07a3-4e1d-b6ca-9ac119d745fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:21.264795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5957-07a3-4e1d-b6ca-9ac119d745fe admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.265084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5957-07a3-4e1d-b6ca-9ac119d745fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.265366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5957-07a3-4e1d-b6ca-9ac119d745fe admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.266017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff5957-07a3-4e1d-b6ca-9ac119d745fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:21.268057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff5957-07a3-4e1d-b6ca-9ac119d745fe admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:21.309563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 732/1463] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:53:21 2021] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:53:21.314056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:21.325830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7897b-cc1a-4c5d-a169-42378add6717 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:21.389781 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521544b-cca9-4d62-af03-06c299fd80e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:21.390297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521544b-cca9-4d62-af03-06c299fd80e2 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.390615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521544b-cca9-4d62-af03-06c299fd80e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.390897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521544b-cca9-4d62-af03-06c299fd80e2 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.391536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521544b-cca9-4d62-af03-06c299fd80e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:21.393451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521544b-cca9-4d62-af03-06c299fd80e2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:21.412268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 732/1464] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:53:21 2021] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:53:21.416563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff5957-07a3-4e1d-b6ca-9ac119d745fe admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:21.428661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff5957-07a3-4e1d-b6ca-9ac119d745fe admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:21.433047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1edc3-a2d9-4862-960a-392f40993b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:21.433646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1edc3-a2d9-4862-960a-392f40993b79 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.434523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1edc3-a2d9-4862-960a-392f40993b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.434831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1edc3-a2d9-4862-960a-392f40993b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.435511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1edc3-a2d9-4862-960a-392f40993b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:21.437105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1edc3-a2d9-4862-960a-392f40993b79 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:21.447679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 733/1465] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:53:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:53:21.451847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521544b-cca9-4d62-af03-06c299fd80e2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:21.461577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521544b-cca9-4d62-af03-06c299fd80e2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:21.465921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a4416-2684-4fab-baef-9e3d4a04434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:21.466547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4416-2684-4fab-baef-9e3d4a04434b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.466888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4416-2684-4fab-baef-9e3d4a04434b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.467174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4416-2684-4fab-baef-9e3d4a04434b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.467875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a4416-2684-4fab-baef-9e3d4a04434b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:21.469466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a4416-2684-4fab-baef-9e3d4a04434b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:21.480052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 733/1466] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:53:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:53:21.488381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1edc3-a2d9-4862-960a-392f40993b79 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:21.498650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1edc3-a2d9-4862-960a-392f40993b79 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:21.503217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98da4-2700-4469-b944-1cf9c882625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:21.504036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98da4-2700-4469-b944-1cf9c882625c admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.504604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98da4-2700-4469-b944-1cf9c882625c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.504604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98da4-2700-4469-b944-1cf9c882625c admin admin] PATH_INFO: `/v3/projects/77a3e2b692de4b90af5b9fdad058c810/users/56fe88d80d4e48469342ac7b11896c29/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.524510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98da4-2700-4469-b944-1cf9c882625c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a3e2b692de4b90af5b9fdad058c810, user_id=56fe88d80d4e48469342ac7b11896c29, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:21.527200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98da4-2700-4469-b944-1cf9c882625c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:21.541721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 734/1467] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:53:21 2021] PUT /identity/v3/projects/77a3e2b692de4b90af5b9fdad058c810/users/56fe88d80d4e48469342ac7b11896c29/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:53:21.553806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16bfb-373d-4485-9c94-6f715a0b079b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.554102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16bfb-373d-4485-9c94-6f715a0b079b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.554436 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16bfb-373d-4485-9c94-6f715a0b079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.592569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-77d16bfb-373d-4485-9c94-6f715a0b079b None None] MFA Rules not processed for user `56fe88d80d4e48469342ac7b11896c29`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:53:21.593720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-77d16bfb-373d-4485-9c94-6f715a0b079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:53:21.664592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 734/1468] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:53:21 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:53:21.675007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98da4-2700-4469-b944-1cf9c882625c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:21.752280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98da4-2700-4469-b944-1cf9c882625c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:21.757473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770d12-f8b3-45cc-bf80-0f22446878e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:21.758055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770d12-f8b3-45cc-bf80-0f22446878e3 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.758347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770d12-f8b3-45cc-bf80-0f22446878e3 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.758659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770d12-f8b3-45cc-bf80-0f22446878e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.767076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770d12-f8b3-45cc-bf80-0f22446878e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:21.768665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770d12-f8b3-45cc-bf80-0f22446878e3 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:21.777176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 735/1469] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:53:21 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:53:21.846731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1d3a-41eb-4d69-a7f3-27e258cc115f None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.847036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1d3a-41eb-4d69-a7f3-27e258cc115f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.847319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1d3a-41eb-4d69-a7f3-27e258cc115f None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.848914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 735/1470] 10.222.0.57 () {52 vars in 829 bytes} [Mon Oct 25 14:53:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:53:21.852716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770d12-f8b3-45cc-bf80-0f22446878e3 service nova] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:21.921101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770d12-f8b3-45cc-bf80-0f22446878e3 service nova] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:21.925362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:21.926172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:21.926484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:21.926766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] PATH_INFO: `/v3/users/56fe88d80d4e48469342ac7b11896c29` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:21.927889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fe88d80d4e48469342ac7b11896c29)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:21.928891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:53:21.928891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:53:21.928891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:53:21.930102 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:21.996250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fe88d80d4e48469342ac7b11896c29'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.004858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fe88d80d4e48469342ac7b11896c29'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.005611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fe88d80d4e48469342ac7b11896c29'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.006582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fe88d80d4e48469342ac7b11896c29'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.023549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fe88d80d4e48469342ac7b11896c29'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.038284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 736/1471] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:53:21 2021] DELETE /identity/v3/users/56fe88d80d4e48469342ac7b11896c29 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:53:22.042736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f1e17-a0fb-4fc3-b0c5-957008455dc5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:22.043118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f1e17-a0fb-4fc3-b0c5-957008455dc5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:22.043408 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f1e17-a0fb-4fc3-b0c5-957008455dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:22.065947 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-650f1e17-a0fb-4fc3-b0c5-957008455dc5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:53:22.067128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-650f1e17-a0fb-4fc3-b0c5-957008455dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:53:22.132699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 736/1472] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:53:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:53:22.143116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:22.144471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:53:22.208401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ed165-2dff-4c04-9682-023e6894d13c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:22.211830 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b3ad-b423-4455-8b29-04f3ccdb8f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:22.212415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b3ad-b423-4455-8b29-04f3ccdb8f52 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:22.212702 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b3ad-b423-4455-8b29-04f3ccdb8f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:22.212980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b3ad-b423-4455-8b29-04f3ccdb8f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:22.221970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b3ad-b423-4455-8b29-04f3ccdb8f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:22.223446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b3ad-b423-4455-8b29-04f3ccdb8f52 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:22.233427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 737/1473] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:53:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:53:22.655907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f1e17-a0fb-4fc3-b0c5-957008455dc5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:53:22.657327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-650f1e17-a0fb-4fc3-b0c5-957008455dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:53:22.669252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f1e17-a0fb-4fc3-b0c5-957008455dc5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:53:22.673816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:53:22.674527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:53:22.674820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:53:22.675059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] PATH_INFO: `/v3/projects/77a3e2b692de4b90af5b9fdad058c810` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:53:22.676166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a3e2b692de4b90af5b9fdad058c810)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:53:22.677201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:53:22.677201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:53:22.677201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:53:22.678576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:53:22.733415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a3e2b692de4b90af5b9fdad058c810', 'request_id': 'req-99445c63-3813-4457-a8e2-9a5a4c147cd4'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.738986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a3e2b692de4b90af5b9fdad058c810', 'request_id': 'req-99445c63-3813-4457-a8e2-9a5a4c147cd4'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.747572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a3e2b692de4b90af5b9fdad058c810', 'request_id': 'req-99445c63-3813-4457-a8e2-9a5a4c147cd4'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.764107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] The token cache is being invalidate because project 77a3e2b692de4b90af5b9fdad058c810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:53:22.764316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.765030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99445c63-3813-4457-a8e2-9a5a4c147cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:53:22.766497 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 737/1474] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:53:22 2021] DELETE /identity/v3/projects/77a3e2b692de4b90af5b9fdad058c810 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:54:53.353444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62d371-82db-4b6d-b360-301c3c0b41d5 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:54:53.354052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62d371-82db-4b6d-b360-301c3c0b41d5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:54:53.354052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62d371-82db-4b6d-b360-301c3c0b41d5 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:54:53.355831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 738/1475] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 25 14:54:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:54:53.361715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec7c27-2191-465f-b4d0-67eec871a2c1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:54:53.362224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec7c27-2191-465f-b4d0-67eec871a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:54:53.362334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec7c27-2191-465f-b4d0-67eec871a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:54:53.384371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1fec7c27-2191-465f-b4d0-67eec871a2c1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:54:53.385533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1fec7c27-2191-465f-b4d0-67eec871a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:54:53.451241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 738/1476] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 25 14:54:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:54:53.602148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62d371-82db-4b6d-b360-301c3c0b41d5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:54:53.603886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ca62d371-82db-4b6d-b360-301c3c0b41d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:54:53.683234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62d371-82db-4b6d-b360-301c3c0b41d5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:54:53.688242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132733f3-38e2-41e6-a361-e9edc2682ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:54:53.688827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132733f3-38e2-41e6-a361-e9edc2682ddb service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:54:53.689114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132733f3-38e2-41e6-a361-e9edc2682ddb service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:54:53.689407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132733f3-38e2-41e6-a361-e9edc2682ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:54:53.698153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132733f3-38e2-41e6-a361-e9edc2682ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:54:53.700340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132733f3-38e2-41e6-a361-e9edc2682ddb service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:54:53.710556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 739/1477] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:54:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:54:54.623757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae80c2-2aec-4a6b-9dbd-6bf618e4caa1 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:54:54.624303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae80c2-2aec-4a6b-9dbd-6bf618e4caa1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:54:54.624463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae80c2-2aec-4a6b-9dbd-6bf618e4caa1 None None] PATH_INFO: `/v3` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:54:54.625680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 739/1478] 10.222.0.37 () {54 vars in 925 bytes} [Mon Oct 25 14:54:54 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:54:54.633209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b63176-a127-444e-b2de-fc1d99cd7a02 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:54:54.633660 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b63176-a127-444e-b2de-fc1d99cd7a02 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:54:54.633777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b63176-a127-444e-b2de-fc1d99cd7a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:54:54.656560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-02b63176-a127-444e-b2de-fc1d99cd7a02 None None] MFA Rules not processed for user `eca65349f42a4b53aa051474cd1c98d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:54:54.657698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-02b63176-a127-444e-b2de-fc1d99cd7a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:54:54.725623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 740/1479] 10.222.0.37 () {58 vars in 1015 bytes} [Mon Oct 25 14:54:54 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:54:55.048959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdee02-4303-42f5-ac8e-fbdf83649539 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:54:55.049247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdee02-4303-42f5-ac8e-fbdf83649539 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:54:55.049533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdee02-4303-42f5-ac8e-fbdf83649539 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:54:55.051257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 740/1480] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 25 14:54:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:54:55.056089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c447-ee71-45de-889c-ea94f65f3375 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:54:55.056385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c447-ee71-45de-889c-ea94f65f3375 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:54:55.056666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c447-ee71-45de-889c-ea94f65f3375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:54:55.079121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0e58c447-ee71-45de-889c-ea94f65f3375 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:54:55.080252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0e58c447-ee71-45de-889c-ea94f65f3375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:54:55.087438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 741/1481] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 25 14:54:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:54:55.235330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdee02-4303-42f5-ac8e-fbdf83649539 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:54:55.248841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdee02-4303-42f5-ac8e-fbdf83649539 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:54:55.253843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac315cf-bfc1-4e2c-9077-823fa0fc329d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:54:55.254413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac315cf-bfc1-4e2c-9077-823fa0fc329d service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:54:55.254777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac315cf-bfc1-4e2c-9077-823fa0fc329d service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:54:55.255053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac315cf-bfc1-4e2c-9077-823fa0fc329d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:54:55.263432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac315cf-bfc1-4e2c-9077-823fa0fc329d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:54:55.265018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac315cf-bfc1-4e2c-9077-823fa0fc329d service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:54:55.273807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 741/1482] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:54:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:55:04.167766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fc36-7389-40af-b907-bb8cca207ad3 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:04.168241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fc36-7389-40af-b907-bb8cca207ad3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:04.168345 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fc36-7389-40af-b907-bb8cca207ad3 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:04.170006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 742/1483] 10.222.0.57 () {54 vars in 960 bytes} [Mon Oct 25 14:55:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:55:04.175072 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba826-e554-425c-a665-8615cda97b26 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:04.175500 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba826-e554-425c-a665-8615cda97b26 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:04.175654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba826-e554-425c-a665-8615cda97b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:04.199361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-366ba826-e554-425c-a665-8615cda97b26 None None] MFA Rules not processed for user `eca65349f42a4b53aa051474cd1c98d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:55:04.200544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-366ba826-e554-425c-a665-8615cda97b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:04.208470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 742/1484] 10.222.0.57 () {58 vars in 1057 bytes} [Mon Oct 25 14:55:04 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:55:04.216156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624fc36-7389-40af-b907-bb8cca207ad3 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:55:04.228858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624fc36-7389-40af-b907-bb8cca207ad3 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:55:04.234235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784da06-688c-4f68-8d37-2930433f1d0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:55:04.234831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784da06-688c-4f68-8d37-2930433f1d0c service placement] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:04.235120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784da06-688c-4f68-8d37-2930433f1d0c service placement] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:04.235401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784da06-688c-4f68-8d37-2930433f1d0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:04.243324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784da06-688c-4f68-8d37-2930433f1d0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:55:04.244899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784da06-688c-4f68-8d37-2930433f1d0c service placement] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:55:04.259480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 743/1485] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:55:04 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:55:07.015518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e945e-8fbe-4ad9-9e10-b94e56850aa9 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:07.016043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e945e-8fbe-4ad9-9e10-b94e56850aa9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:07.016043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e945e-8fbe-4ad9-9e10-b94e56850aa9 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:07.017700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 25 14:55:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:55:07.022602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1464a-e932-4f10-ad9c-fdda8ba192b2 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:07.023052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1464a-e932-4f10-ad9c-fdda8ba192b2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:07.023164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1464a-e932-4f10-ad9c-fdda8ba192b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:07.046425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-8dd1464a-e932-4f10-ad9c-fdda8ba192b2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:55:07.047604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8dd1464a-e932-4f10-ad9c-fdda8ba192b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:07.054933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 25 14:55:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:55:07.202166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e945e-8fbe-4ad9-9e10-b94e56850aa9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:55:07.215702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e945e-8fbe-4ad9-9e10-b94e56850aa9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:55:07.220680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5b69e-49ef-4744-ada3-1b1f4659386a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:55:07.221237 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b69e-49ef-4744-ada3-1b1f4659386a service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:07.221526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b69e-49ef-4744-ada3-1b1f4659386a service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:07.221805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b69e-49ef-4744-ada3-1b1f4659386a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:07.229606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5b69e-49ef-4744-ada3-1b1f4659386a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:55:07.231695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5b69e-49ef-4744-ada3-1b1f4659386a service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:55:07.241057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 744/1488] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:55:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:55:08.568082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ccd7-8be4-4f5a-bdd6-f898241d79ab None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:08.568683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ccd7-8be4-4f5a-bdd6-f898241d79ab None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:08.568683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ccd7-8be4-4f5a-bdd6-f898241d79ab None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:08.570382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 25 14:55:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:55:08.575311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16731-5506-45e7-a7d2-4d28e50dad24 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:08.575733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16731-5506-45e7-a7d2-4d28e50dad24 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:08.575881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16731-5506-45e7-a7d2-4d28e50dad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:08.597839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-79f16731-5506-45e7-a7d2-4d28e50dad24 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:55:08.599039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-79f16731-5506-45e7-a7d2-4d28e50dad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:08.606716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 25 14:55:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:55:08.754490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ccd7-8be4-4f5a-bdd6-f898241d79ab None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:55:08.767762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ccd7-8be4-4f5a-bdd6-f898241d79ab None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:55:08.772741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be22ae9-676e-4eb8-ac7c-ba8a7cd363cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:55:08.773300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22ae9-676e-4eb8-ac7c-ba8a7cd363cf service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:08.773584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22ae9-676e-4eb8-ac7c-ba8a7cd363cf service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:08.773862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22ae9-676e-4eb8-ac7c-ba8a7cd363cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:08.782359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be22ae9-676e-4eb8-ac7c-ba8a7cd363cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:55:08.783972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be22ae9-676e-4eb8-ac7c-ba8a7cd363cf service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:55:08.792997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 746/1491] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:55:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:55:12.937981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037c77f-ca85-4a60-8ab4-be52adeda2cd None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:12.938575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037c77f-ca85-4a60-8ab4-be52adeda2cd None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:12.938575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037c77f-ca85-4a60-8ab4-be52adeda2cd None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:12.940265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Mon Oct 25 14:55:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:55:12.945400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246830f-ba23-42ec-9a29-f5c0c162fe9f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:12.945858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246830f-ba23-42ec-9a29-f5c0c162fe9f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:12.945969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246830f-ba23-42ec-9a29-f5c0c162fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:12.969157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c246830f-ba23-42ec-9a29-f5c0c162fe9f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:55:12.970141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c246830f-ba23-42ec-9a29-f5c0c162fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:12.977344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Oct 25 14:55:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:55:13.014603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037c77f-ca85-4a60-8ab4-be52adeda2cd None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:55:13.016221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c037c77f-ca85-4a60-8ab4-be52adeda2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:13.079431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037c77f-ca85-4a60-8ab4-be52adeda2cd None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:55:13.082835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecb0d-4943-426f-8058-07d27442cba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:55:13.083402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecb0d-4943-426f-8058-07d27442cba5 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:13.083690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecb0d-4943-426f-8058-07d27442cba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:13.083974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecb0d-4943-426f-8058-07d27442cba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:13.092654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ecb0d-4943-426f-8058-07d27442cba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:55:13.094078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ecb0d-4943-426f-8058-07d27442cba5 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:55:13.103110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 747/1494] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:55:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:55:15.204149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3557515-fc96-47f0-81b7-0afe96f4e282 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:15.204733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3557515-fc96-47f0-81b7-0afe96f4e282 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:15.204733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3557515-fc96-47f0-81b7-0afe96f4e282 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:15.206418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Mon Oct 25 14:55:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:55:15.211807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee813-6160-4881-9a5e-50a18bf36a17 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:15.212252 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee813-6160-4881-9a5e-50a18bf36a17 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:15.212451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee813-6160-4881-9a5e-50a18bf36a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:15.236141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-b52ee813-6160-4881-9a5e-50a18bf36a17 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:55:15.237283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b52ee813-6160-4881-9a5e-50a18bf36a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:15.244484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Oct 25 14:55:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:55:15.281752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3557515-fc96-47f0-81b7-0afe96f4e282 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:55:15.292372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3557515-fc96-47f0-81b7-0afe96f4e282 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:55:15.295811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b9db0-acb4-41a4-812f-b42315bff927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:55:15.296386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b9db0-acb4-41a4-812f-b42315bff927 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:15.296676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b9db0-acb4-41a4-812f-b42315bff927 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:15.296985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b9db0-acb4-41a4-812f-b42315bff927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:15.306205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b9db0-acb4-41a4-812f-b42315bff927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:55:15.307728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b9db0-acb4-41a4-812f-b42315bff927 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:55:15.316899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 749/1497] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:55:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:55:19.045853 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186b3f-44a9-48ff-a7e6-dc0975bbbb93 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:19.046489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186b3f-44a9-48ff-a7e6-dc0975bbbb93 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:19.046489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186b3f-44a9-48ff-a7e6-dc0975bbbb93 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:19.048224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Mon Oct 25 14:55:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:55:19.054068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db8f47-a545-419f-9f4d-a138d2d3964c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:19.054674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db8f47-a545-419f-9f4d-a138d2d3964c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:19.054674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db8f47-a545-419f-9f4d-a138d2d3964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:19.079401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a1db8f47-a545-419f-9f4d-a138d2d3964c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:55:19.080557 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a1db8f47-a545-419f-9f4d-a138d2d3964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:19.087781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Oct 25 14:55:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:55:19.145624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186b3f-44a9-48ff-a7e6-dc0975bbbb93 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:55:19.147323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7b186b3f-44a9-48ff-a7e6-dc0975bbbb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:19.218338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186b3f-44a9-48ff-a7e6-dc0975bbbb93 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:55:19.221825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26525d11-7d09-462c-b6a8-4c2673c141ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:55:19.222456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26525d11-7d09-462c-b6a8-4c2673c141ba service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:19.222752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26525d11-7d09-462c-b6a8-4c2673c141ba service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:19.223037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26525d11-7d09-462c-b6a8-4c2673c141ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:19.233986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26525d11-7d09-462c-b6a8-4c2673c141ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:55:19.235540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26525d11-7d09-462c-b6a8-4c2673c141ba service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:55:19.246644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 750/1500] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:55:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:55:21.362089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909708-c85a-47e9-8918-7026cbe70f08 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:21.362710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909708-c85a-47e9-8918-7026cbe70f08 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:21.362710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909708-c85a-47e9-8918-7026cbe70f08 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:21.364358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 751/1501] 127.0.0.1 () {54 vars in 916 bytes} [Mon Oct 25 14:55:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:55:21.369437 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57c2d3-92ef-4451-82dd-7b3d9ff0e8eb None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:21.369846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57c2d3-92ef-4451-82dd-7b3d9ff0e8eb None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:21.370002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57c2d3-92ef-4451-82dd-7b3d9ff0e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:21.392592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0e57c2d3-92ef-4451-82dd-7b3d9ff0e8eb None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:55:21.393732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0e57c2d3-92ef-4451-82dd-7b3d9ff0e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:21.400885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 751/1502] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Oct 25 14:55:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:55:21.457272 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cba7d-1c5d-45ac-8f81-ef6abef4023d None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:21.457554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cba7d-1c5d-45ac-8f81-ef6abef4023d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:21.457835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cba7d-1c5d-45ac-8f81-ef6abef4023d None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:21.459549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 752/1503] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 25 14:55:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:55:21.464747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691432ab-f132-4e6a-8ceb-bc50d68bfe5e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:21.465041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691432ab-f132-4e6a-8ceb-bc50d68bfe5e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:21.465326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691432ab-f132-4e6a-8ceb-bc50d68bfe5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:21.488603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-691432ab-f132-4e6a-8ceb-bc50d68bfe5e None None] MFA Rules not processed for user `29ed619258a14a148654f372f3a6a6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:55:21.489799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-691432ab-f132-4e6a-8ceb-bc50d68bfe5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:55:21.496726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 752/1504] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 25 14:55:21 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:55:21.504584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cba7d-1c5d-45ac-8f81-ef6abef4023d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:55:21.514976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cba7d-1c5d-45ac-8f81-ef6abef4023d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:55:21.518294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc7279-d9da-4483-8846-0186bccac116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:55:21.518882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7279-d9da-4483-8846-0186bccac116 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:55:21.519164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7279-d9da-4483-8846-0186bccac116 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:55:21.519440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7279-d9da-4483-8846-0186bccac116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:55:21.528518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc7279-d9da-4483-8846-0186bccac116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:55:21.529919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc7279-d9da-4483-8846-0186bccac116 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:55:21.538985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 753/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:55:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:03.156426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e79bd-beae-401f-9ef6-96742728d1ce None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.157036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e79bd-beae-401f-9ef6-96742728d1ce None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.157441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e79bd-beae-401f-9ef6-96742728d1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.217199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7f7e79bd-beae-401f-9ef6-96742728d1ce None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:03.219179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7f7e79bd-beae-401f-9ef6-96742728d1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:03.238664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 753/1506] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:03.255874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66a313-728c-41b2-b952-98fbabdb0336 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.256686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66a313-728c-41b2-b952-98fbabdb0336 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.256686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66a313-728c-41b2-b952-98fbabdb0336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.291714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-bc66a313-728c-41b2-b952-98fbabdb0336 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:03.292888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bc66a313-728c-41b2-b952-98fbabdb0336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:03.305833 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 754/1507] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:57:03.313697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e79bd-beae-401f-9ef6-96742728d1ce None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:03.328576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e79bd-beae-401f-9ef6-96742728d1ce None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:03.339063 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:03.339689 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.339968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.340251 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.341507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:03.341806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:03.343465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:03.373802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 754/1508] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:03.389701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66a313-728c-41b2-b952-98fbabdb0336 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:03.402346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66a313-728c-41b2-b952-98fbabdb0336 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:03.410675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87167a-537e-4336-b846-4a154b97f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:03.411200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87167a-537e-4336-b846-4a154b97f1cb admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.411480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87167a-537e-4336-b846-4a154b97f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.411756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87167a-537e-4336-b846-4a154b97f1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.412408 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87167a-537e-4336-b846-4a154b97f1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:03.414423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87167a-537e-4336-b846-4a154b97f1cb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:03.464517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 755/1509] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:03.472945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:03.486430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b50b91-1ecf-42ea-b968-5e7c9ba92bf0 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.486430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b50b91-1ecf-42ea-b968-5e7c9ba92bf0 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.486430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b50b91-1ecf-42ea-b968-5e7c9ba92bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.501385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c609fc-540b-4e66-99f3-c93b38b22dda admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:03.517624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-32b50b91-1ecf-42ea-b968-5e7c9ba92bf0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:03.519131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-32b50b91-1ecf-42ea-b968-5e7c9ba92bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:03.630156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 756/1510] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:03.638963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc363-ae2c-4c1f-abd9-c0462e64246f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.639313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc363-ae2c-4c1f-abd9-c0462e64246f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.639514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc363-ae2c-4c1f-abd9-c0462e64246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.673225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e4ccc363-ae2c-4c1f-abd9-c0462e64246f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:03.678624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e4ccc363-ae2c-4c1f-abd9-c0462e64246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:03.694509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 757/1511] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:03.694758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ce4c3-1c71-4a6f-9990-53f1b02411c5 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.695066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ce4c3-1c71-4a6f-9990-53f1b02411c5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.695435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ce4c3-1c71-4a6f-9990-53f1b02411c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.700746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5159c7-bbee-468d-bf9a-8de4a0560d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:03.702273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5159c7-bbee-468d-bf9a-8de4a0560d2f admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.703153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5159c7-bbee-468d-bf9a-8de4a0560d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.703961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5159c7-bbee-468d-bf9a-8de4a0560d2f admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.705525 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5159c7-bbee-468d-bf9a-8de4a0560d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:03.710101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5159c7-bbee-468d-bf9a-8de4a0560d2f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:03.735300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-ce2ce4c3-1c71-4a6f-9990-53f1b02411c5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:03.736492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ce2ce4c3-1c71-4a6f-9990-53f1b02411c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:03.755524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 758/1512] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:03.756114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ce4c3-1c71-4a6f-9990-53f1b02411c5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:03.763109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 755/1513] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:03.765917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eb2c5-d8c0-4ac3-830e-94552d8f6456 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.771099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ce4c3-1c71-4a6f-9990-53f1b02411c5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:03.772193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eb2c5-d8c0-4ac3-830e-94552d8f6456 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.772872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eb2c5-d8c0-4ac3-830e-94552d8f6456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.780600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:03.781361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.781656 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.781929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.782672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:03.782975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:03.784969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:03.810637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 759/1514] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:03.810637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:03.834445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de191c-3f1d-4135-b6c5-b0c4d18e6386 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:03.850884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-945eb2c5-d8c0-4ac3-830e-94552d8f6456 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:03.862531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274bfd-0968-4b7b-8ee4-1f1cd8ecdae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:03.862531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274bfd-0968-4b7b-8ee4-1f1cd8ecdae1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.862531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274bfd-0968-4b7b-8ee4-1f1cd8ecdae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.862531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274bfd-0968-4b7b-8ee4-1f1cd8ecdae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.863281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00274bfd-0968-4b7b-8ee4-1f1cd8ecdae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:03.864361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00274bfd-0968-4b7b-8ee4-1f1cd8ecdae1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:03.865684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-945eb2c5-d8c0-4ac3-830e-94552d8f6456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:03.890053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 760/1515] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:03.896688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274bfd-0968-4b7b-8ee4-1f1cd8ecdae1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:03.906921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 756/1516] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:03.909450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eb2c5-d8c0-4ac3-830e-94552d8f6456 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:03.916104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274bfd-0968-4b7b-8ee4-1f1cd8ecdae1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:03.936432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a000e-6b97-4a0d-9f06-b09afc2fadb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:03.936922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a000e-6b97-4a0d-9f06-b09afc2fadb2 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.937209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a000e-6b97-4a0d-9f06-b09afc2fadb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.937640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a000e-6b97-4a0d-9f06-b09afc2fadb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.938123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a000e-6b97-4a0d-9f06-b09afc2fadb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:03.942435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a000e-6b97-4a0d-9f06-b09afc2fadb2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:03.946077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eb2c5-d8c0-4ac3-830e-94552d8f6456 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:03.971881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4b8fb-6439-4c9f-97ae-bc2a3e012f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:03.973869 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4b8fb-6439-4c9f-97ae-bc2a3e012f1b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:03.974821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4b8fb-6439-4c9f-97ae-bc2a3e012f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:03.977000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4b8fb-6439-4c9f-97ae-bc2a3e012f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:03.978861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4b8fb-6439-4c9f-97ae-bc2a3e012f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:03.988333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4b8fb-6439-4c9f-97ae-bc2a3e012f1b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.000390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 761/1517] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:03 2021] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:04.001260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a000e-6b97-4a0d-9f06-b09afc2fadb2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.020667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 757/1518] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:04.023336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4b8fb-6439-4c9f-97ae-bc2a3e012f1b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.056086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4b8fb-6439-4c9f-97ae-bc2a3e012f1b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.149795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a000e-6b97-4a0d-9f06-b09afc2fadb2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.154331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743792-23aa-4a83-80a7-350c5c5902a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.155235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743792-23aa-4a83-80a7-350c5c5902a0 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.155577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.155788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743792-23aa-4a83-80a7-350c5c5902a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.156201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743792-23aa-4a83-80a7-350c5c5902a0 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.156648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.156998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.157164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743792-23aa-4a83-80a7-350c5c5902a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.157848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.157998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:04.158362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.159971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743792-23aa-4a83-80a7-350c5c5902a0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.160128 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.173253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 762/1519] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:04.174378 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.191135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0ec8-4dc1-4871-a523-fb073551fed5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.192499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 758/1520] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:04.196740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c085c2-a9d7-4bc7-8581-e51e82a0ea07 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.197020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c085c2-a9d7-4bc7-8581-e51e82a0ea07 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.197360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c085c2-a9d7-4bc7-8581-e51e82a0ea07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.197715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c634c34-eba4-43a1-8044-53a7b1b053a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.199164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634c34-eba4-43a1-8044-53a7b1b053a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.199640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634c34-eba4-43a1-8044-53a7b1b053a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.200706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634c34-eba4-43a1-8044-53a7b1b053a7 admin admin] PATH_INFO: `/v3/projects/f775951e4c0e43ab8e9a421071c6c3d4/users/aa6c8c2103534ca28f981d39cecb2c70/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.224684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-14c085c2-a9d7-4bc7-8581-e51e82a0ea07 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.226087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-14c085c2-a9d7-4bc7-8581-e51e82a0ea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.227740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c634c34-eba4-43a1-8044-53a7b1b053a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f775951e4c0e43ab8e9a421071c6c3d4, user_id=aa6c8c2103534ca28f981d39cecb2c70, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.231360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c634c34-eba4-43a1-8044-53a7b1b053a7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.242373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 759/1521] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.242373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa171-a12b-4b0d-afe1-a7a2478f0931 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.242373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa171-a12b-4b0d-afe1-a7a2478f0931 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.242373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa171-a12b-4b0d-afe1-a7a2478f0931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.264525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 763/1522] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:04 2021] PUT /identity/v3/projects/f775951e4c0e43ab8e9a421071c6c3d4/users/aa6c8c2103534ca28f981d39cecb2c70/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:04.265967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352e83c-5e5d-430c-b2ce-dba2558953cb None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.266254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352e83c-5e5d-430c-b2ce-dba2558953cb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.266560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352e83c-5e5d-430c-b2ce-dba2558953cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.273841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1f4aa171-a12b-4b0d-afe1-a7a2478f0931 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.275059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1f4aa171-a12b-4b0d-afe1-a7a2478f0931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.298109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c352e83c-5e5d-430c-b2ce-dba2558953cb None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.299385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c352e83c-5e5d-430c-b2ce-dba2558953cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.353421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 760/1523] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.355077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c5bb-2880-4aa4-b854-cdec2b58637e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.355558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c5bb-2880-4aa4-b854-cdec2b58637e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.355838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c5bb-2880-4aa4-b854-cdec2b58637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.379247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4ab3c5bb-2880-4aa4-b854-cdec2b58637e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.380406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4ab3c5bb-2880-4aa4-b854-cdec2b58637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.388363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 761/1524] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.389169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3c5bb-2880-4aa4-b854-cdec2b58637e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.406797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3c5bb-2880-4aa4-b854-cdec2b58637e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.411589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08349fef-ab0c-450e-a7dc-2291f3309f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.412171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 764/1525] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.421513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349fef-ab0c-450e-a7dc-2291f3309f8b admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.421513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349fef-ab0c-450e-a7dc-2291f3309f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.421513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349fef-ab0c-450e-a7dc-2291f3309f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.422017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352e83c-5e5d-430c-b2ce-dba2558953cb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.422167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08349fef-ab0c-450e-a7dc-2291f3309f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.422167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08349fef-ab0c-450e-a7dc-2291f3309f8b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.427741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352e83c-5e5d-430c-b2ce-dba2558953cb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.432433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ec238-2565-49a3-9d26-6be06c6188f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.433038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec238-2565-49a3-9d26-6be06c6188f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.433329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec238-2565-49a3-9d26-6be06c6188f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.433615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec238-2565-49a3-9d26-6be06c6188f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.434338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ec238-2565-49a3-9d26-6be06c6188f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.436424 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ec238-2565-49a3-9d26-6be06c6188f3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.447583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 765/1526] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:04.448714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26228dc7-450d-4be2-8fe6-038ec68485aa None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.449003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26228dc7-450d-4be2-8fe6-038ec68485aa None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.449497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26228dc7-450d-4be2-8fe6-038ec68485aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.457172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 762/1527] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:04.457172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36244238-38e0-49e8-b969-bf9d9d3c5416 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.457172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36244238-38e0-49e8-b969-bf9d9d3c5416 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.457172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36244238-38e0-49e8-b969-bf9d9d3c5416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.477725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-26228dc7-450d-4be2-8fe6-038ec68485aa None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.478934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-26228dc7-450d-4be2-8fe6-038ec68485aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.485706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-36244238-38e0-49e8-b969-bf9d9d3c5416 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.486894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-36244238-38e0-49e8-b969-bf9d9d3c5416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.584743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 766/1528] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.586949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbebfe-e33d-464b-b012-296a92fd8e85 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.587564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbebfe-e33d-464b-b012-296a92fd8e85 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.588043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbebfe-e33d-464b-b012-296a92fd8e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.595777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 763/1529] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.597514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f2f1-257b-48d6-8b26-f0ac2b0b2a3c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.597844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f2f1-257b-48d6-8b26-f0ac2b0b2a3c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.598239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f2f1-257b-48d6-8b26-f0ac2b0b2a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.612620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5fdbebfe-e33d-464b-b012-296a92fd8e85 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.613801 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5fdbebfe-e33d-464b-b012-296a92fd8e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.621233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 767/1530] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.623080 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840bb95-935f-41f2-85ad-84ba83390e87 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.623370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840bb95-935f-41f2-85ad-84ba83390e87 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.623652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840bb95-935f-41f2-85ad-84ba83390e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.626216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-3ce1f2f1-257b-48d6-8b26-f0ac2b0b2a3c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.626981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-3ce1f2f1-257b-48d6-8b26-f0ac2b0b2a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.635795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 764/1531] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.637167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eded09-38f8-42e6-9c9f-5699866d27ae None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.638259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eded09-38f8-42e6-9c9f-5699866d27ae None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.640021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eded09-38f8-42e6-9c9f-5699866d27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.652497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e840bb95-935f-41f2-85ad-84ba83390e87 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.657515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e840bb95-935f-41f2-85ad-84ba83390e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.662146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-60eded09-38f8-42e6-9c9f-5699866d27ae None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.663395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-60eded09-38f8-42e6-9c9f-5699866d27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.665570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 768/1532] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.666431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840bb95-935f-41f2-85ad-84ba83390e87 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.676106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840bb95-935f-41f2-85ad-84ba83390e87 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.676773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 765/1533] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.679543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eded09-38f8-42e6-9c9f-5699866d27ae None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.681544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274368e-0d58-41ee-82ab-e6aac9cc6776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.682315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274368e-0d58-41ee-82ab-e6aac9cc6776 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.682801 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274368e-0d58-41ee-82ab-e6aac9cc6776 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.683127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274368e-0d58-41ee-82ab-e6aac9cc6776 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.683804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274368e-0d58-41ee-82ab-e6aac9cc6776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.685986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274368e-0d58-41ee-82ab-e6aac9cc6776 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.689950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eded09-38f8-42e6-9c9f-5699866d27ae None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.694697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67bf85-c3a6-4845-8ba3-5c4d566623de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.695306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67bf85-c3a6-4845-8ba3-5c4d566623de admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.695594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67bf85-c3a6-4845-8ba3-5c4d566623de admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.695882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67bf85-c3a6-4845-8ba3-5c4d566623de admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.696532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67bf85-c3a6-4845-8ba3-5c4d566623de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.696674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 769/1534] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:04.697664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274368e-0d58-41ee-82ab-e6aac9cc6776 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.703032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67bf85-c3a6-4845-8ba3-5c4d566623de admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.708417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274368e-0d58-41ee-82ab-e6aac9cc6776 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.713166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552570d3-bd58-4d97-8d75-7af3fbd528a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.713779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552570d3-bd58-4d97-8d75-7af3fbd528a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.714321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552570d3-bd58-4d97-8d75-7af3fbd528a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.714700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552570d3-bd58-4d97-8d75-7af3fbd528a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.715421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552570d3-bd58-4d97-8d75-7af3fbd528a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:04.716235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552570d3-bd58-4d97-8d75-7af3fbd528a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.718166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552570d3-bd58-4d97-8d75-7af3fbd528a1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.733786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 770/1535] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:04.742733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2b4d-b98c-4bc9-818c-e51e02e9f1ab None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.742733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2b4d-b98c-4bc9-818c-e51e02e9f1ab None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.742733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2b4d-b98c-4bc9-818c-e51e02e9f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.743178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 766/1536] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/users => generated 283 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:04.743178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67bf85-c3a6-4845-8ba3-5c4d566623de admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.774422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-189c2b4d-b98c-4bc9-818c-e51e02e9f1ab None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:04.776288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-189c2b4d-b98c-4bc9-818c-e51e02e9f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:04.786369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 771/1537] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:04.791441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2b4d-b98c-4bc9-818c-e51e02e9f1ab None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.813172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2b4d-b98c-4bc9-818c-e51e02e9f1ab None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.817338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67bf85-c3a6-4845-8ba3-5c4d566623de admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.820916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.822022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.822795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.823147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.824570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:04.825654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.826800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd7d0-5604-4841-a761-e32565d86e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.827647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd7d0-5604-4841-a761-e32565d86e4c service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.828107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd7d0-5604-4841-a761-e32565d86e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.828686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd7d0-5604-4841-a761-e32565d86e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.828815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.839640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bd7d0-5604-4841-a761-e32565d86e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.841394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bd7d0-5604-4841-a761-e32565d86e4c service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.852310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 767/1538] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:04.853425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 772/1539] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:04.853682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd7d0-5604-4841-a761-e32565d86e4c service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.854896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.882162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd7d0-5604-4841-a761-e32565d86e4c service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.886750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c931b8-c68a-4b55-84f0-c6d5ab2f9672 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.891547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.892633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.893386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.893946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.895592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:04.895729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.896453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.896597 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.897630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.899010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.899668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:04.900254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.900644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.902471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.924545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 768/1540] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:04.926146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.936821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 773/1541] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:04.939981 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.946912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e5ec4-9451-4763-987e-248fa44f21ec admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.954901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb09c-4c38-4f9a-a44c-a71aa668ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.956146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb09c-4c38-4f9a-a44c-a71aa668ac51 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.956626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb09c-4c38-4f9a-a44c-a71aa668ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.957095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb09c-4c38-4f9a-a44c-a71aa668ac51 admin admin] PATH_INFO: `/v3/projects/4a8a71f562124751a24c84588a42e5d5/users/a40bbf2de51e477ba060d27c3245d796/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.958802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe4842-2f91-4c1d-ab58-9e8a8908c562 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:04.966633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b07630-0969-4cd1-8b15-cefbe4a13c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:04.967284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07630-0969-4cd1-8b15-cefbe4a13c4f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:04.968074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07630-0969-4cd1-8b15-cefbe4a13c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:04.968505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07630-0969-4cd1-8b15-cefbe4a13c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:04.969732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b07630-0969-4cd1-8b15-cefbe4a13c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.972628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b07630-0969-4cd1-8b15-cefbe4a13c4f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:04.989395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb09c-4c38-4f9a-a44c-a71aa668ac51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a71f562124751a24c84588a42e5d5, user_id=a40bbf2de51e477ba060d27c3245d796, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:04.992250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 774/1542] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:04.993922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b07630-0969-4cd1-8b15-cefbe4a13c4f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:04.999150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb09c-4c38-4f9a-a44c-a71aa668ac51 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.021539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b07630-0969-4cd1-8b15-cefbe4a13c4f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.023309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 769/1543] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:04 2021] PUT /identity/v3/projects/4a8a71f562124751a24c84588a42e5d5/users/a40bbf2de51e477ba060d27c3245d796/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:05.029726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb09c-4c38-4f9a-a44c-a71aa668ac51 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.116487 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370738ff-fe66-45dd-a3ed-bebc16242dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.117585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370738ff-fe66-45dd-a3ed-bebc16242dbc admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.118088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370738ff-fe66-45dd-a3ed-bebc16242dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.118602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370738ff-fe66-45dd-a3ed-bebc16242dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.119432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370738ff-fe66-45dd-a3ed-bebc16242dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.122554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370738ff-fe66-45dd-a3ed-bebc16242dbc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.150166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb09c-4c38-4f9a-a44c-a71aa668ac51 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.157506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.158864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.159355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.159922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.161478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:05.161961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.165229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.171566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 775/1544] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:04 2021] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.172685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370738ff-fe66-45dd-a3ed-bebc16242dbc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.191143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 770/1545] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:05.192897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.211833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7222520-b7af-4f46-827e-0db55010e2c2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.262606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370738ff-fe66-45dd-a3ed-bebc16242dbc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.269600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a85d0-5862-4162-b8bb-74deb54f6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.270494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a85d0-5862-4162-b8bb-74deb54f6bcc admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.270667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a85d0-5862-4162-b8bb-74deb54f6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.271059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a85d0-5862-4162-b8bb-74deb54f6bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.271798 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a85d0-5862-4162-b8bb-74deb54f6bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.273881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a85d0-5862-4162-b8bb-74deb54f6bcc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.312350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 776/1546] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.312350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a85d0-5862-4162-b8bb-74deb54f6bcc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.315974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556082-bd00-4afa-a25b-46930b8df2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.317330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556082-bd00-4afa-a25b-46930b8df2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.317978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556082-bd00-4afa-a25b-46930b8df2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.318620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556082-bd00-4afa-a25b-46930b8df2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.320097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b556082-bd00-4afa-a25b-46930b8df2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.324049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b556082-bd00-4afa-a25b-46930b8df2c3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.385529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 771/1547] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/projects => generated 391 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.385529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556082-bd00-4afa-a25b-46930b8df2c3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.411973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a85d0-5862-4162-b8bb-74deb54f6bcc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.486247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e5549-dbf9-4ced-b919-9ae908690663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.487161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5549-dbf9-4ced-b919-9ae908690663 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.487555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5549-dbf9-4ced-b919-9ae908690663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.487937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5549-dbf9-4ced-b919-9ae908690663 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.488696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e5549-dbf9-4ced-b919-9ae908690663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.490932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e5549-dbf9-4ced-b919-9ae908690663 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.495105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556082-bd00-4afa-a25b-46930b8df2c3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.503449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e48b6-43f6-4583-9dc3-bb4c753f4f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.504055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e48b6-43f6-4583-9dc3-bb4c753f4f87 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.504533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e48b6-43f6-4583-9dc3-bb4c753f4f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.505036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e48b6-43f6-4583-9dc3-bb4c753f4f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.506589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e48b6-43f6-4583-9dc3-bb4c753f4f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.509905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e48b6-43f6-4583-9dc3-bb4c753f4f87 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.521823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 777/1548] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.526852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474ad4-4570-438c-82cd-59f3cc51a414 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.527192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474ad4-4570-438c-82cd-59f3cc51a414 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.527727 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474ad4-4570-438c-82cd-59f3cc51a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.537385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 772/1549] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:05.537385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e48b6-43f6-4583-9dc3-bb4c753f4f87 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.553555 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e48b6-43f6-4583-9dc3-bb4c753f4f87 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.555098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e5474ad4-4570-438c-82cd-59f3cc51a414 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:05.556268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e5474ad4-4570-438c-82cd-59f3cc51a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:05.633900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 778/1550] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:05.634965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474ad4-4570-438c-82cd-59f3cc51a414 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.646505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474ad4-4570-438c-82cd-59f3cc51a414 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.654709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bec011-f510-4e06-9e3b-b456bd4e9325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.657638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec011-f510-4e06-9e3b-b456bd4e9325 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.657999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec011-f510-4e06-9e3b-b456bd4e9325 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.658926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec011-f510-4e06-9e3b-b456bd4e9325 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.660650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bec011-f510-4e06-9e3b-b456bd4e9325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.662216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2356b47-39e2-4f00-9736-1a415ba1a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.663268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356b47-39e2-4f00-9736-1a415ba1a183 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.663390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bec011-f510-4e06-9e3b-b456bd4e9325 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.663511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356b47-39e2-4f00-9736-1a415ba1a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.663753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356b47-39e2-4f00-9736-1a415ba1a183 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.664405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2356b47-39e2-4f00-9736-1a415ba1a183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.666586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2356b47-39e2-4f00-9736-1a415ba1a183 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.695427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 773/1551] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.696492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2356b47-39e2-4f00-9736-1a415ba1a183 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.696831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 779/1552] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.697836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bec011-f510-4e06-9e3b-b456bd4e9325 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.710193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2356b47-39e2-4f00-9736-1a415ba1a183 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.784900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fd807-3d7b-418c-9ee5-fa34acfa82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.786450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fd807-3d7b-418c-9ee5-fa34acfa82d1 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.787879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fd807-3d7b-418c-9ee5-fa34acfa82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.788167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fd807-3d7b-418c-9ee5-fa34acfa82d1 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.789746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fd807-3d7b-418c-9ee5-fa34acfa82d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.793009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fd807-3d7b-418c-9ee5-fa34acfa82d1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.805116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bec011-f510-4e06-9e3b-b456bd4e9325 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.810951 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90eeb-3ba1-4a5e-bd72-72eecc0d31b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.811738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90eeb-3ba1-4a5e-bd72-72eecc0d31b7 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.812031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90eeb-3ba1-4a5e-bd72-72eecc0d31b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.812642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90eeb-3ba1-4a5e-bd72-72eecc0d31b7 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.813324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc90eeb-3ba1-4a5e-bd72-72eecc0d31b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.816182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc90eeb-3ba1-4a5e-bd72-72eecc0d31b7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.830604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 774/1553] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.831434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fd807-3d7b-418c-9ee5-fa34acfa82d1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.844181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fd807-3d7b-418c-9ee5-fa34acfa82d1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.849148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 780/1554] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.850112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90eeb-3ba1-4a5e-bd72-72eecc0d31b7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.850967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3f0f4-5308-4895-8f20-5894e17f57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.851898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f0f4-5308-4895-8f20-5894e17f57a5 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.852143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f0f4-5308-4895-8f20-5894e17f57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.852996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f0f4-5308-4895-8f20-5894e17f57a5 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.853551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3f0f4-5308-4895-8f20-5894e17f57a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.862304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3f0f4-5308-4895-8f20-5894e17f57a5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.877410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90eeb-3ba1-4a5e-bd72-72eecc0d31b7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:05.883577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6e633-18cb-43b0-97bf-070ff44010d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:05.884429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e633-18cb-43b0-97bf-070ff44010d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:05.884728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e633-18cb-43b0-97bf-070ff44010d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:05.885011 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e633-18cb-43b0-97bf-070ff44010d9 admin admin] PATH_INFO: `/v3/projects/5f011125854a4b7ab910e581b331cffe/users/281d9be71ef046e6a1005830d31c5718/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:05.903486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 775/1555] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:05 2021] POST /identity/v3/users => generated 292 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:05.905444 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3f0f4-5308-4895-8f20-5894e17f57a5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:05.910286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6e633-18cb-43b0-97bf-070ff44010d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f011125854a4b7ab910e581b331cffe, user_id=281d9be71ef046e6a1005830d31c5718, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:05.913169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6e633-18cb-43b0-97bf-070ff44010d9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:05.938882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 781/1556] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:05 2021] PUT /identity/v3/projects/5f011125854a4b7ab910e581b331cffe/users/281d9be71ef046e6a1005830d31c5718/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:05.940019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6e633-18cb-43b0-97bf-070ff44010d9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.046083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6e633-18cb-43b0-97bf-070ff44010d9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.051611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659624e1-3ac5-40f6-afaa-58aa59a26ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.052238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659624e1-3ac5-40f6-afaa-58aa59a26ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.052528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659624e1-3ac5-40f6-afaa-58aa59a26ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.052811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659624e1-3ac5-40f6-afaa-58aa59a26ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.053523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659624e1-3ac5-40f6-afaa-58aa59a26ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.055572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659624e1-3ac5-40f6-afaa-58aa59a26ae5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.058967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3f0f4-5308-4895-8f20-5894e17f57a5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.069629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 782/1557] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.070469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659624e1-3ac5-40f6-afaa-58aa59a26ae5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.083479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659624e1-3ac5-40f6-afaa-58aa59a26ae5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.088864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b40e6-8760-49ee-bb2f-6e1b552f3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.089625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b40e6-8760-49ee-bb2f-6e1b552f3f08 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.089923 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b40e6-8760-49ee-bb2f-6e1b552f3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.090206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b40e6-8760-49ee-bb2f-6e1b552f3f08 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.090942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b40e6-8760-49ee-bb2f-6e1b552f3f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.092898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b40e6-8760-49ee-bb2f-6e1b552f3f08 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.119868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 783/1558] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:06 2021] POST /identity/v3/users => generated 290 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:06.120624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b40e6-8760-49ee-bb2f-6e1b552f3f08 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.132879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc26aa-c4b4-475a-8ffd-e30bbabe550a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.133348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b40e6-8760-49ee-bb2f-6e1b552f3f08 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.133668 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc26aa-c4b4-475a-8ffd-e30bbabe550a service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.134052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc26aa-c4b4-475a-8ffd-e30bbabe550a service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.134470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc26aa-c4b4-475a-8ffd-e30bbabe550a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.141369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55c494-597e-432d-9c63-260673de8cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.141982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c494-597e-432d-9c63-260673de8cff admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.142277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c494-597e-432d-9c63-260673de8cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.142597 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c494-597e-432d-9c63-260673de8cff admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.143309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55c494-597e-432d-9c63-260673de8cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.144965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55c494-597e-432d-9c63-260673de8cff admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.161616 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc26aa-c4b4-475a-8ffd-e30bbabe550a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.162829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 784/1559] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.163793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55c494-597e-432d-9c63-260673de8cff admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.164217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc26aa-c4b4-475a-8ffd-e30bbabe550a service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.175097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55c494-597e-432d-9c63-260673de8cff admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.177578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 776/1560] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:06.179014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc26aa-c4b4-475a-8ffd-e30bbabe550a service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.180668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d465-a73a-449b-9003-99f01f0c7a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.181300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d465-a73a-449b-9003-99f01f0c7a4e admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.181591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d465-a73a-449b-9003-99f01f0c7a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.181876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d465-a73a-449b-9003-99f01f0c7a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.182617 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348d465-a73a-449b-9003-99f01f0c7a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.184806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348d465-a73a-449b-9003-99f01f0c7a4e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.193557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc26aa-c4b4-475a-8ffd-e30bbabe550a service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.197428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 785/1561] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.202158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2984b-c7c6-4610-bae5-dcea0a0c5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.202857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de924b39-9d0c-4d30-86ef-a9dbbe3a7c02 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.203178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2984b-c7c6-4610-bae5-dcea0a0c5848 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.203308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de924b39-9d0c-4d30-86ef-a9dbbe3a7c02 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.203533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2984b-c7c6-4610-bae5-dcea0a0c5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.203678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de924b39-9d0c-4d30-86ef-a9dbbe3a7c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.203973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2984b-c7c6-4610-bae5-dcea0a0c5848 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.204716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2984b-c7c6-4610-bae5-dcea0a0c5848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.206557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2984b-c7c6-4610-bae5-dcea0a0c5848 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.221262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 777/1562] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.221262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2984b-c7c6-4610-bae5-dcea0a0c5848 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.230092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2984b-c7c6-4610-bae5-dcea0a0c5848 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.236071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7729673-5d9a-4f4f-bb2d-52062fbe7456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.236739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729673-5d9a-4f4f-bb2d-52062fbe7456 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.237034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729673-5d9a-4f4f-bb2d-52062fbe7456 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.237432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729673-5d9a-4f4f-bb2d-52062fbe7456 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.238546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7729673-5d9a-4f4f-bb2d-52062fbe7456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.241101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7729673-5d9a-4f4f-bb2d-52062fbe7456 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.251276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-de924b39-9d0c-4d30-86ef-a9dbbe3a7c02 None None] MFA Rules not processed for user `281d9be71ef046e6a1005830d31c5718`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:06.253086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-de924b39-9d0c-4d30-86ef-a9dbbe3a7c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:06.254655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 778/1563] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.255806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7729673-5d9a-4f4f-bb2d-52062fbe7456 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.267204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7729673-5d9a-4f4f-bb2d-52062fbe7456 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.275016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624f73-6275-4e49-b05a-02637220d17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.275636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624f73-6275-4e49-b05a-02637220d17f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.275928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624f73-6275-4e49-b05a-02637220d17f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.276215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624f73-6275-4e49-b05a-02637220d17f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.276935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624f73-6275-4e49-b05a-02637220d17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.279261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624f73-6275-4e49-b05a-02637220d17f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.297905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 779/1564] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.299523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624f73-6275-4e49-b05a-02637220d17f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.318021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624f73-6275-4e49-b05a-02637220d17f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.329642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e60562-ba4f-4149-8c81-9777bf10076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.331727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e60562-ba4f-4149-8c81-9777bf10076d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.332253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e60562-ba4f-4149-8c81-9777bf10076d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.332863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e60562-ba4f-4149-8c81-9777bf10076d admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.334678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e60562-ba4f-4149-8c81-9777bf10076d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.338056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e60562-ba4f-4149-8c81-9777bf10076d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.354838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 780/1565] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.355597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e60562-ba4f-4149-8c81-9777bf10076d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.365579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 786/1566] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:06 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:06.365579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de924b39-9d0c-4d30-86ef-a9dbbe3a7c02 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.367017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e60562-ba4f-4149-8c81-9777bf10076d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.373279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15741c8a-b2f0-460b-8fa5-8f07e156e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.373894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15741c8a-b2f0-460b-8fa5-8f07e156e2cb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.374189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15741c8a-b2f0-460b-8fa5-8f07e156e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.374530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15741c8a-b2f0-460b-8fa5-8f07e156e2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.375431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15741c8a-b2f0-460b-8fa5-8f07e156e2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.377055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15741c8a-b2f0-460b-8fa5-8f07e156e2cb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.377596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de924b39-9d0c-4d30-86ef-a9dbbe3a7c02 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.382606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f52247-db7d-4883-9854-aea10f945e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.383705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52247-db7d-4883-9854-aea10f945e48 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.384090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52247-db7d-4883-9854-aea10f945e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.384465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52247-db7d-4883-9854-aea10f945e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.385385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f52247-db7d-4883-9854-aea10f945e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.387859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f52247-db7d-4883-9854-aea10f945e48 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.392175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 781/1567] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.393021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15741c8a-b2f0-460b-8fa5-8f07e156e2cb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.399981 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 787/1568] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.401314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f52247-db7d-4883-9854-aea10f945e48 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.412447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15741c8a-b2f0-460b-8fa5-8f07e156e2cb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.414907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f52247-db7d-4883-9854-aea10f945e48 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.420571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1aaec-a1f1-4eec-816a-195ef8a9d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.421503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aaec-a1f1-4eec-816a-195ef8a9d589 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.422102 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aaec-a1f1-4eec-816a-195ef8a9d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.422637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aaec-a1f1-4eec-816a-195ef8a9d589 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.423547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1aaec-a1f1-4eec-816a-195ef8a9d589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.424259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f196ac2-216d-4cce-a6d7-6fb094b83c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.425473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196ac2-216d-4cce-a6d7-6fb094b83c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.426054 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196ac2-216d-4cce-a6d7-6fb094b83c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.426506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1aaec-a1f1-4eec-816a-195ef8a9d589 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.426806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196ac2-216d-4cce-a6d7-6fb094b83c02 admin admin] PATH_INFO: `/v3/projects/4cff7774374f43209ee9732824e7c503/users/2b645197b9284843ba53434934a2a19f/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.448867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 788/1569] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:06.450951 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1aaec-a1f1-4eec-816a-195ef8a9d589 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.462973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f196ac2-216d-4cce-a6d7-6fb094b83c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cff7774374f43209ee9732824e7c503, user_id=2b645197b9284843ba53434934a2a19f, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.464584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f196ac2-216d-4cce-a6d7-6fb094b83c02 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.470040 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1aaec-a1f1-4eec-816a-195ef8a9d589 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.482178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572976f2-2f26-4c55-a315-ef65f51e6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.485533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 782/1570] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:06 2021] PUT /identity/v3/projects/4cff7774374f43209ee9732824e7c503/users/2b645197b9284843ba53434934a2a19f/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:06.485971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572976f2-2f26-4c55-a315-ef65f51e6aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.486783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572976f2-2f26-4c55-a315-ef65f51e6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.487470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572976f2-2f26-4c55-a315-ef65f51e6aa7 admin admin] PATH_INFO: `/v3/projects/3a9810c0a7924973bc94af80b227f0b8/users/38216820f81f473f83cbb34e7667dc46/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.498182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f196ac2-216d-4cce-a6d7-6fb094b83c02 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.524062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572976f2-2f26-4c55-a315-ef65f51e6aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9810c0a7924973bc94af80b227f0b8, user_id=38216820f81f473f83cbb34e7667dc46, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.527623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572976f2-2f26-4c55-a315-ef65f51e6aa7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.557240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 789/1571] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:06 2021] PUT /identity/v3/projects/3a9810c0a7924973bc94af80b227f0b8/users/38216820f81f473f83cbb34e7667dc46/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:06.557240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572976f2-2f26-4c55-a315-ef65f51e6aa7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.591927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f196ac2-216d-4cce-a6d7-6fb094b83c02 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.635303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572976f2-2f26-4c55-a315-ef65f51e6aa7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.640718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77342049-0783-438a-a2d3-b8610ef76985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.642012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77342049-0783-438a-a2d3-b8610ef76985 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.642502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77342049-0783-438a-a2d3-b8610ef76985 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.642909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77342049-0783-438a-a2d3-b8610ef76985 admin admin] PATH_INFO: `/v3/projects/bd3772dcd21e433081b8ba499e61cfb6/users/f770ae4a0a644c12aa9bd1e7860faebf/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.667311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77342049-0783-438a-a2d3-b8610ef76985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3772dcd21e433081b8ba499e61cfb6, user_id=f770ae4a0a644c12aa9bd1e7860faebf, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.670892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77342049-0783-438a-a2d3-b8610ef76985 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.687363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 790/1572] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:06 2021] PUT /identity/v3/projects/bd3772dcd21e433081b8ba499e61cfb6/users/f770ae4a0a644c12aa9bd1e7860faebf/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:06.688709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77342049-0783-438a-a2d3-b8610ef76985 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.754200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368169b-5a4d-42ff-bc35-7b8a9129f25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.755347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368169b-5a4d-42ff-bc35-7b8a9129f25d service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.756138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368169b-5a4d-42ff-bc35-7b8a9129f25d service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.756625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368169b-5a4d-42ff-bc35-7b8a9129f25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.818052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77342049-0783-438a-a2d3-b8610ef76985 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:06.835766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a69a7-f114-4fc9-a817-4acde09b44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:06.836679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a69a7-f114-4fc9-a817-4acde09b44c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.837072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a69a7-f114-4fc9-a817-4acde09b44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.837475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a69a7-f114-4fc9-a817-4acde09b44c2 admin admin] PATH_INFO: `/v3/projects/670374964f714196ab5d431e5e2fc9bd/users/9e0b49f365a542c080e2bdb043dc1387/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:06.879512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a69a7-f114-4fc9-a817-4acde09b44c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670374964f714196ab5d431e5e2fc9bd, user_id=9e0b49f365a542c080e2bdb043dc1387, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.882612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a69a7-f114-4fc9-a817-4acde09b44c2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.899888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368169b-5a4d-42ff-bc35-7b8a9129f25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:06.901144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 791/1573] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:06 2021] PUT /identity/v3/projects/670374964f714196ab5d431e5e2fc9bd/users/9e0b49f365a542c080e2bdb043dc1387/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:06.902295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a69a7-f114-4fc9-a817-4acde09b44c2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:06.904969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368169b-5a4d-42ff-bc35-7b8a9129f25d service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:06.934776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 783/1574] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:06 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:06.938326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d10b4-d553-4d97-9987-7a3b374ef2e4 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:06.940340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d10b4-d553-4d97-9987-7a3b374ef2e4 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:06.941108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d10b4-d553-4d97-9987-7a3b374ef2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.023110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ff4d10b4-d553-4d97-9987-7a3b374ef2e4 None None] MFA Rules not processed for user `2b645197b9284843ba53434934a2a19f`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:07.025757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ff4d10b4-d553-4d97-9987-7a3b374ef2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:07.055695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a69a7-f114-4fc9-a817-4acde09b44c2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:07.073145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7fe2-069c-4437-847d-107a3e2330f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:07.074176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7fe2-069c-4437-847d-107a3e2330f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.074615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7fe2-069c-4437-847d-107a3e2330f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.075106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7fe2-069c-4437-847d-107a3e2330f8 admin admin] PATH_INFO: `/v3/projects/4def6089a3ce4a96abe3bc16aa351ab0/users/a5dd78b96cba4122b51c5fa296ccc59a/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.105823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7fe2-069c-4437-847d-107a3e2330f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4def6089a3ce4a96abe3bc16aa351ab0, user_id=a5dd78b96cba4122b51c5fa296ccc59a, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:07.109704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7fe2-069c-4437-847d-107a3e2330f8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:07.148426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 792/1575] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:06 2021] PUT /identity/v3/projects/4def6089a3ce4a96abe3bc16aa351ab0/users/a5dd78b96cba4122b51c5fa296ccc59a/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:07.148426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8896530-e245-4663-ab9b-1608817a234d None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.148426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8896530-e245-4663-ab9b-1608817a234d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.148426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8896530-e245-4663-ab9b-1608817a234d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.224453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f8896530-e245-4663-ab9b-1608817a234d None None] MFA Rules not processed for user `38216820f81f473f83cbb34e7667dc46`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:07.225839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f8896530-e245-4663-ab9b-1608817a234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:07.247382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 784/1576] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:06 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:07.249924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a131b8-44a8-493d-9024-9c3975d92355 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.250453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a131b8-44a8-493d-9024-9c3975d92355 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.250928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a131b8-44a8-493d-9024-9c3975d92355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.301994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-37a131b8-44a8-493d-9024-9c3975d92355 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:07.303867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-37a131b8-44a8-493d-9024-9c3975d92355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:07.409048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 785/1577] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:07.410685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64e96b-7a45-47b4-a8aa-5e159cd16dbc None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.410905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64e96b-7a45-47b4-a8aa-5e159cd16dbc None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.411622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64e96b-7a45-47b4-a8aa-5e159cd16dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.438954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 793/1578] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:07 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:07.447254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea016b2-1db2-47b7-af13-c35b956d667c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.450891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea016b2-1db2-47b7-af13-c35b956d667c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.451596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea016b2-1db2-47b7-af13-c35b956d667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.464465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-cb64e96b-7a45-47b4-a8aa-5e159cd16dbc None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:07.466432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-cb64e96b-7a45-47b4-a8aa-5e159cd16dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:07.479469 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 786/1579] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:07.480817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64e96b-7a45-47b4-a8aa-5e159cd16dbc None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:07.498084 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64e96b-7a45-47b4-a8aa-5e159cd16dbc None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:07.504871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:07.505494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.505788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.506077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.506876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:07.512774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:07.594655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 787/1580] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:07 2021] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:07.595835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:07.598025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:07.604662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1ea016b2-1db2-47b7-af13-c35b956d667c None None] MFA Rules not processed for user `a5dd78b96cba4122b51c5fa296ccc59a`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:07.611312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1ea016b2-1db2-47b7-af13-c35b956d667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:07.860568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6eb0-c6f3-4865-93b5-5abde30313b2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:07.863728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 794/1581] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:07 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:07.865665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2dea4-e34c-48dd-9dac-8b8860c84b91 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.866080 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2dea4-e34c-48dd-9dac-8b8860c84b91 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.866606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2dea4-e34c-48dd-9dac-8b8860c84b91 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.868942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 795/1582] 10.222.0.57 () {54 vars in 954 bytes} [Mon Oct 25 14:57:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:07.869925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2dea4-e34c-48dd-9dac-8b8860c84b91 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:07.884795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3b45-19f1-4f90-abe7-29d1ae5a8ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:07.885409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3b45-19f1-4f90-abe7-29d1ae5a8ebf service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.885704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3b45-19f1-4f90-abe7-29d1ae5a8ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.885975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3b45-19f1-4f90-abe7-29d1ae5a8ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:07.943318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2dea4-e34c-48dd-9dac-8b8860c84b91 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:07.953231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c619b02-3dec-4fd6-8485-e2865d06a458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:07.957904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c619b02-3dec-4fd6-8485-e2865d06a458 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:07.958737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c619b02-3dec-4fd6-8485-e2865d06a458 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:07.959370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c619b02-3dec-4fd6-8485-e2865d06a458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.053087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf3b45-19f1-4f90-abe7-29d1ae5a8ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:08.054938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf3b45-19f1-4f90-abe7-29d1ae5a8ebf service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:08.075511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 788/1583] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:08.083476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3b45-19f1-4f90-abe7-29d1ae5a8ebf service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:08.101799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3b45-19f1-4f90-abe7-29d1ae5a8ebf service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:08.115197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab124b-d331-4054-b2c0-d62d0d1d6407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:08.115823 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab124b-d331-4054-b2c0-d62d0d1d6407 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:08.116113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab124b-d331-4054-b2c0-d62d0d1d6407 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:08.116391 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab124b-d331-4054-b2c0-d62d0d1d6407 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.117586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab124b-d331-4054-b2c0-d62d0d1d6407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:08.120341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab124b-d331-4054-b2c0-d62d0d1d6407 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:08.175663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 789/1584] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:08 2021] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:08.176636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab124b-d331-4054-b2c0-d62d0d1d6407 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:08.200697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab124b-d331-4054-b2c0-d62d0d1d6407 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:08.211267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f1e7-1927-41ac-bbdb-feae147351f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:08.211902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f1e7-1927-41ac-bbdb-feae147351f8 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:08.212193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f1e7-1927-41ac-bbdb-feae147351f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:08.212588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f1e7-1927-41ac-bbdb-feae147351f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.213255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0f1e7-1927-41ac-bbdb-feae147351f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:08.216362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0f1e7-1927-41ac-bbdb-feae147351f8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:08.263629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c619b02-3dec-4fd6-8485-e2865d06a458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:08.274495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c619b02-3dec-4fd6-8485-e2865d06a458 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:08.291341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 790/1585] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:08 2021] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:08.293457 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8b97-95d0-4f7f-ab28-3de7f4efd70f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:08.293880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8b97-95d0-4f7f-ab28-3de7f4efd70f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:08.294249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8b97-95d0-4f7f-ab28-3de7f4efd70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.332048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 796/1586] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:08.334165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c619b02-3dec-4fd6-8485-e2865d06a458 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:08.346343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-bf9e8b97-95d0-4f7f-ab28-3de7f4efd70f None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:08.347750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bf9e8b97-95d0-4f7f-ab28-3de7f4efd70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:08.360007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c619b02-3dec-4fd6-8485-e2865d06a458 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:08.446052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 791/1587] 10.222.0.57 () {58 vars in 1051 bytes} [Mon Oct 25 14:57:08 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:08.447409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e8b97-95d0-4f7f-ab28-3de7f4efd70f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:08.565339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6900aef-4ab5-48e6-a0fa-f57270312c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:08.566436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900aef-4ab5-48e6-a0fa-f57270312c86 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:08.566956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900aef-4ab5-48e6-a0fa-f57270312c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:08.569538 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900aef-4ab5-48e6-a0fa-f57270312c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.571374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6900aef-4ab5-48e6-a0fa-f57270312c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:08.575976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6900aef-4ab5-48e6-a0fa-f57270312c86 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:08.589986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e8b97-95d0-4f7f-ab28-3de7f4efd70f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:08.615190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de74d6-73bc-4981-b185-07bdc6735b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:08.615190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de74d6-73bc-4981-b185-07bdc6735b77 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:08.615190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de74d6-73bc-4981-b185-07bdc6735b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:08.615190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de74d6-73bc-4981-b185-07bdc6735b77 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.615633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de74d6-73bc-4981-b185-07bdc6735b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:08.615633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de74d6-73bc-4981-b185-07bdc6735b77 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:08.615784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 797/1588] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:08 2021] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:08.615784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b70ba-0dfd-457d-8f5b-5c80e3df97ae None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:08.615784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b70ba-0dfd-457d-8f5b-5c80e3df97ae None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:08.615784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b70ba-0dfd-457d-8f5b-5c80e3df97ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.675794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 792/1589] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:08 2021] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:08.676716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de74d6-73bc-4981-b185-07bdc6735b77 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:08.705171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de74d6-73bc-4981-b185-07bdc6735b77 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:08.717940 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c73600-38cf-4b94-b59f-819da389b77e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:08.718633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73600-38cf-4b94-b59f-819da389b77e service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:08.718927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73600-38cf-4b94-b59f-819da389b77e service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:08.719190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73600-38cf-4b94-b59f-819da389b77e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.753199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-238b70ba-0dfd-457d-8f5b-5c80e3df97ae None None] MFA Rules not processed for user `a40bbf2de51e477ba060d27c3245d796`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:08.760795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-238b70ba-0dfd-457d-8f5b-5c80e3df97ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:08.866345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73600-38cf-4b94-b59f-819da389b77e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:08.874583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73600-38cf-4b94-b59f-819da389b77e service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:08.895909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 793/1590] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:08 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:08.896772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c73600-38cf-4b94-b59f-819da389b77e service nova] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:08.933666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c73600-38cf-4b94-b59f-819da389b77e service nova] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:08.943777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214142b6-8b26-4bf7-a024-31626f7cc13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:08.944993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214142b6-8b26-4bf7-a024-31626f7cc13a admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:08.945442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214142b6-8b26-4bf7-a024-31626f7cc13a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:08.945881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214142b6-8b26-4bf7-a024-31626f7cc13a admin admin] PATH_INFO: `/v3/projects/fc6034f27dd94879bff81b03453230c1/users/2bc1c60abc074989b5cf427a7afba89c/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:08.993415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214142b6-8b26-4bf7-a024-31626f7cc13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6034f27dd94879bff81b03453230c1, user_id=2bc1c60abc074989b5cf427a7afba89c, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:08.997347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214142b6-8b26-4bf7-a024-31626f7cc13a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:09.055624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 794/1591] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:08 2021] PUT /identity/v3/projects/fc6034f27dd94879bff81b03453230c1/users/2bc1c60abc074989b5cf427a7afba89c/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:09.056626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214142b6-8b26-4bf7-a024-31626f7cc13a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:09.084503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 798/1592] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:08 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:09.092575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b70ba-0dfd-457d-8f5b-5c80e3df97ae None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:09.148708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b70ba-0dfd-457d-8f5b-5c80e3df97ae None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:09.276959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214142b6-8b26-4bf7-a024-31626f7cc13a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:09.294996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b212b-16fa-4cd1-b4c5-cffd312f5c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:09.298174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b212b-16fa-4cd1-b4c5-cffd312f5c17 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:09.300621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b212b-16fa-4cd1-b4c5-cffd312f5c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:09.301752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b212b-16fa-4cd1-b4c5-cffd312f5c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:09.304400 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b212b-16fa-4cd1-b4c5-cffd312f5c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:09.313068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b212b-16fa-4cd1-b4c5-cffd312f5c17 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:09.390087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 795/1593] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:09 2021] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:09.400814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb6b8-c63c-4d04-acae-498d2d3b3f7e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:09.404846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb6b8-c63c-4d04-acae-498d2d3b3f7e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:09.406546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb6b8-c63c-4d04-acae-498d2d3b3f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:09.474208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f57023-d228-4082-a946-79b380078c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:09.475527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f57023-d228-4082-a946-79b380078c69 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:09.476173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f57023-d228-4082-a946-79b380078c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:09.476793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f57023-d228-4082-a946-79b380078c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:09.478303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f57023-d228-4082-a946-79b380078c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:09.491507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f57023-d228-4082-a946-79b380078c69 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:09.505093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1cfdb6b8-c63c-4d04-acae-498d2d3b3f7e None None] MFA Rules not processed for user `a40bbf2de51e477ba060d27c3245d796`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:09.506620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1cfdb6b8-c63c-4d04-acae-498d2d3b3f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:09.541051 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 799/1594] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:09 2021] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:09.545435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f57023-d228-4082-a946-79b380078c69 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:09.594186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f57023-d228-4082-a946-79b380078c69 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:09.604608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971292ab-e4a0-4b93-afc6-9975e4f1c626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:09.606556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971292ab-e4a0-4b93-afc6-9975e4f1c626 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:09.607297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971292ab-e4a0-4b93-afc6-9975e4f1c626 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:09.608852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971292ab-e4a0-4b93-afc6-9975e4f1c626 admin admin] PATH_INFO: `/v3/projects/13756a3a34f54427a120b9e464bd7c42/users/babaf77103f14896ab7c8cb4996fa346/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:09.668063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971292ab-e4a0-4b93-afc6-9975e4f1c626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13756a3a34f54427a120b9e464bd7c42, user_id=babaf77103f14896ab7c8cb4996fa346, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:09.674485 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971292ab-e4a0-4b93-afc6-9975e4f1c626 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:09.716195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 796/1595] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:09 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:09.716195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdb6b8-c63c-4d04-acae-498d2d3b3f7e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:09.729210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 800/1596] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:09 2021] PUT /identity/v3/projects/13756a3a34f54427a120b9e464bd7c42/users/babaf77103f14896ab7c8cb4996fa346/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:09.734201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971292ab-e4a0-4b93-afc6-9975e4f1c626 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:09.747183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdb6b8-c63c-4d04-acae-498d2d3b3f7e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:09.976357 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3aa382-1a8c-468e-bdd3-e2526a4aec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:09.984224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa382-1a8c-468e-bdd3-e2526a4aec77 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:09.985041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa382-1a8c-468e-bdd3-e2526a4aec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:09.986847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aa382-1a8c-468e-bdd3-e2526a4aec77 admin admin] PATH_INFO: `/v3/projects/fc6034f27dd94879bff81b03453230c1/users/2bc1c60abc074989b5cf427a7afba89c/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:10.000289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3aa382-1a8c-468e-bdd3-e2526a4aec77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6034f27dd94879bff81b03453230c1, user_id=2bc1c60abc074989b5cf427a7afba89c, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:10.017893 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3aa382-1a8c-468e-bdd3-e2526a4aec77 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:10.068332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 797/1597] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:09 2021] PUT /identity/v3/projects/fc6034f27dd94879bff81b03453230c1/users/2bc1c60abc074989b5cf427a7afba89c/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:10.073643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8009c-da5c-47b4-b38c-2ec289450cc6 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:10.078228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8009c-da5c-47b4-b38c-2ec289450cc6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:10.079104 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8009c-da5c-47b4-b38c-2ec289450cc6 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:10.088209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 798/1598] 10.222.0.57 () {54 vars in 954 bytes} [Mon Oct 25 14:57:10 2021] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:10.092866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01762b-48cc-4efd-973c-26ea9ba10357 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:10.094864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01762b-48cc-4efd-973c-26ea9ba10357 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:10.097858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01762b-48cc-4efd-973c-26ea9ba10357 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:10.108441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 799/1599] 10.222.0.57 () {54 vars in 912 bytes} [Mon Oct 25 14:57:10 2021] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:10.114515 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92e4a-f2ed-49d3-8e4e-35757c74d4ef None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:10.115225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92e4a-f2ed-49d3-8e4e-35757c74d4ef None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:10.117819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92e4a-f2ed-49d3-8e4e-35757c74d4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:10.122087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971292ab-e4a0-4b93-afc6-9975e4f1c626 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:10.278516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-5fd92e4a-f2ed-49d3-8e4e-35757c74d4ef None None] MFA Rules not processed for user `2bc1c60abc074989b5cf427a7afba89c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:10.280950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5fd92e4a-f2ed-49d3-8e4e-35757c74d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:10.337795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a66ff5-a189-4e81-80bf-ac47c13e83db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:10.338973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a66ff5-a189-4e81-80bf-ac47c13e83db admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:10.339738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a66ff5-a189-4e81-80bf-ac47c13e83db admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:10.340313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a66ff5-a189-4e81-80bf-ac47c13e83db admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:10.341205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a66ff5-a189-4e81-80bf-ac47c13e83db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:10.343138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a66ff5-a189-4e81-80bf-ac47c13e83db admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:10.359733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 801/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:09 2021] GET /identity/v3/roles => generated 1420 bytes in 627 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:10.362083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea508e-d8f0-44c5-8e5e-c25adfa29c41 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:10.362784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea508e-d8f0-44c5-8e5e-c25adfa29c41 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:10.364851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea508e-d8f0-44c5-8e5e-c25adfa29c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:10.456278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-3cea508e-d8f0-44c5-8e5e-c25adfa29c41 None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:10.458529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3cea508e-d8f0-44c5-8e5e-c25adfa29c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:10.522271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 800/1601] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:10 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:10.526935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370323-d2fb-43cd-b347-50d4bb673280 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:10.528630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370323-d2fb-43cd-b347-50d4bb673280 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:10.529227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370323-d2fb-43cd-b347-50d4bb673280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:10.577871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-27370323-d2fb-43cd-b347-50d4bb673280 None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:10.581172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-27370323-d2fb-43cd-b347-50d4bb673280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:10.698073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 802/1602] 10.222.0.57 () {58 vars in 1051 bytes} [Mon Oct 25 14:57:10 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:10.699815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea508e-d8f0-44c5-8e5e-c25adfa29c41 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:10.721591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea508e-d8f0-44c5-8e5e-c25adfa29c41 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:10.730742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3656841-2529-4180-b19d-0733b3306fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:10.734098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656841-2529-4180-b19d-0733b3306fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:10.734618 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656841-2529-4180-b19d-0733b3306fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:10.735260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656841-2529-4180-b19d-0733b3306fb8 admin admin] PATH_INFO: `/v3/projects/13756a3a34f54427a120b9e464bd7c42/users/babaf77103f14896ab7c8cb4996fa346/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:10.739359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3656841-2529-4180-b19d-0733b3306fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13756a3a34f54427a120b9e464bd7c42, user_id=babaf77103f14896ab7c8cb4996fa346, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:10.746331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3656841-2529-4180-b19d-0733b3306fb8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:10.765552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 801/1603] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 14:57:10 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:10.766433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370323-d2fb-43cd-b347-50d4bb673280 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:10.795301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 803/1604] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:10 2021] PUT /identity/v3/projects/13756a3a34f54427a120b9e464bd7c42/users/babaf77103f14896ab7c8cb4996fa346/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:10.797086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3656841-2529-4180-b19d-0733b3306fb8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:10.973395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370323-d2fb-43cd-b347-50d4bb673280 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:11.039147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3656841-2529-4180-b19d-0733b3306fb8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:11.050644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193765-3c59-46a9-b6b1-605a52541792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:11.051683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193765-3c59-46a9-b6b1-605a52541792 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:11.052433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193765-3c59-46a9-b6b1-605a52541792 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:11.052942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193765-3c59-46a9-b6b1-605a52541792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:11.245169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab498c8-9835-44a5-8115-044af39758d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:11.246168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab498c8-9835-44a5-8115-044af39758d0 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:11.251811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab498c8-9835-44a5-8115-044af39758d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:11.252515 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab498c8-9835-44a5-8115-044af39758d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:11.312518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193765-3c59-46a9-b6b1-605a52541792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:11.314203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193765-3c59-46a9-b6b1-605a52541792 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:11.335871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 804/1605] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:10 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:11.351457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193765-3c59-46a9-b6b1-605a52541792 service nova] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:11.372643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193765-3c59-46a9-b6b1-605a52541792 service nova] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:11.376561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb9205-6906-46fc-9740-622359402d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:11.377166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9205-6906-46fc-9740-622359402d1f service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:11.377449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9205-6906-46fc-9740-622359402d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:11.377728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9205-6906-46fc-9740-622359402d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:11.405276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb9205-6906-46fc-9740-622359402d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:11.406781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb9205-6906-46fc-9740-622359402d1f service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:11.432786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 805/1606] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:11 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:11.434194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f76c-d4e5-4d74-bf03-a7b12b0eec64 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:11.434515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f76c-d4e5-4d74-bf03-a7b12b0eec64 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:11.434806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f76c-d4e5-4d74-bf03-a7b12b0eec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:11.450346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab498c8-9835-44a5-8115-044af39758d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:11.458757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab498c8-9835-44a5-8115-044af39758d0 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:11.503348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-bd77f76c-d4e5-4d74-bf03-a7b12b0eec64 None None] MFA Rules not processed for user `babaf77103f14896ab7c8cb4996fa346`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:11.504535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bd77f76c-d4e5-4d74-bf03-a7b12b0eec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:11.526459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 802/1607] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:10 2021] GET /identity/v3/auth/tokens => generated 3777 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:11.530781 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ae7c-5837-496b-a619-3e31ac4e4e6a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:11.531744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ae7c-5837-496b-a619-3e31ac4e4e6a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:11.532544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ae7c-5837-496b-a619-3e31ac4e4e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:11.676139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 806/1608] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:11 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:11.684890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f76c-d4e5-4d74-bf03-a7b12b0eec64 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:11.720306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c7b3ae7c-5837-496b-a619-3e31ac4e4e6a None None] MFA Rules not processed for user `9e0b49f365a542c080e2bdb043dc1387`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:11.744162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c7b3ae7c-5837-496b-a619-3e31ac4e4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:12.012845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f76c-d4e5-4d74-bf03-a7b12b0eec64 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:12.060867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:12.064890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:12.070744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:12.072390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] PATH_INFO: `/v3/users/a5dd78b96cba4122b51c5fa296ccc59a` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:12.087722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5dd78b96cba4122b51c5fa296ccc59a)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:12.104632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:12.252607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 803/1609] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:11 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 724 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:12.253140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ae7c-5837-496b-a619-3e31ac4e4e6a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:12.295418 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ae7c-5837-496b-a619-3e31ac4e4e6a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:12.308767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:12.310185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:12.310503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:12.310789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] PATH_INFO: `/v3/users/2b645197b9284843ba53434934a2a19f` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:12.317775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b645197b9284843ba53434934a2a19f)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:12.329358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: WARNING py.warnings [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:57:12.329358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: warnings.warn(msg) Oct 25 14:57:12.329358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: Oct 25 14:57:12.330715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:12.445144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5dd78b96cba4122b51c5fa296ccc59a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.472008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5dd78b96cba4122b51c5fa296ccc59a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.473250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5dd78b96cba4122b51c5fa296ccc59a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.474841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5dd78b96cba4122b51c5fa296ccc59a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.499236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b645197b9284843ba53434934a2a19f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.513824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b645197b9284843ba53434934a2a19f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.514593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b645197b9284843ba53434934a2a19f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.515225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b645197b9284843ba53434934a2a19f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.525904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a159b56e-394d-4f9a-8558-72c1684bcc4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b645197b9284843ba53434934a2a19f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.528546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d42186f9-b2b7-4745-ab66-dfdbf6c98069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5dd78b96cba4122b51c5fa296ccc59a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:12.555389 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 804/1610] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:57:12 2021] DELETE /identity/v3/users/2b645197b9284843ba53434934a2a19f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:12.556428 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66c7e-0534-4acc-8e5f-9a012968ee6c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:12.556728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66c7e-0534-4acc-8e5f-9a012968ee6c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:12.557014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66c7e-0534-4acc-8e5f-9a012968ee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:12.581392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 807/1611] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:57:11 2021] DELETE /identity/v3/users/a5dd78b96cba4122b51c5fa296ccc59a => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:57:12.585556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5710d7-f94a-498c-9655-6a9bb849dff4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:12.585845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5710d7-f94a-498c-9655-6a9bb849dff4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:12.586132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5710d7-f94a-498c-9655-6a9bb849dff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:12.623463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6ee66c7e-0534-4acc-8e5f-9a012968ee6c None None] MFA Rules not processed for user `9e0b49f365a542c080e2bdb043dc1387`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:12.626224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6ee66c7e-0534-4acc-8e5f-9a012968ee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:12.675627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-dc5710d7-f94a-498c-9655-6a9bb849dff4 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:12.676852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-dc5710d7-f94a-498c-9655-6a9bb849dff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:12.770840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 805/1612] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:12 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:12.772546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38e3f-aa13-4a2a-815f-9a15d5a0122c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:12.773040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38e3f-aa13-4a2a-815f-9a15d5a0122c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:12.795127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38e3f-aa13-4a2a-815f-9a15d5a0122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:12.880800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-58f38e3f-aa13-4a2a-815f-9a15d5a0122c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:12.882022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-58f38e3f-aa13-4a2a-815f-9a15d5a0122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:12.928288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 808/1613] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:12.928288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d06197-79a6-467d-b69c-689f194d848b None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:12.928288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d06197-79a6-467d-b69c-689f194d848b None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:12.928288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d06197-79a6-467d-b69c-689f194d848b None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:12.931214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 809/1614] 10.222.0.57 () {54 vars in 912 bytes} [Mon Oct 25 14:57:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:12.952930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d06197-79a6-467d-b69c-689f194d848b None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:12.962507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e3d06197-79a6-467d-b69c-689f194d848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:13.046342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d06197-79a6-467d-b69c-689f194d848b None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:13.060667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:13.062327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:13.062858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:13.063369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] PATH_INFO: `/v3/users/38216820f81f473f83cbb34e7667dc46` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:13.074653 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38216820f81f473f83cbb34e7667dc46)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:13.079190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:13.201113 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38216820f81f473f83cbb34e7667dc46'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:13.203840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 806/1615] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:13.204852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38e3f-aa13-4a2a-815f-9a15d5a0122c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:13.211808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-58f38e3f-aa13-4a2a-815f-9a15d5a0122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:13.230748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38216820f81f473f83cbb34e7667dc46'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:13.236682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38216820f81f473f83cbb34e7667dc46'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:13.238745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38216820f81f473f83cbb34e7667dc46'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:13.313775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a4c5c38f-283e-43c9-8b9f-94fc74286214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38216820f81f473f83cbb34e7667dc46'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:13.354489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 810/1616] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:57:12 2021] DELETE /identity/v3/users/38216820f81f473f83cbb34e7667dc46 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:13.357450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f05f6f-6c7f-4337-a074-220b835ea2aa None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:13.358209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f05f6f-6c7f-4337-a074-220b835ea2aa None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:13.358742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f05f6f-6c7f-4337-a074-220b835ea2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:13.402841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-31f05f6f-6c7f-4337-a074-220b835ea2aa None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:13.405129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-31f05f6f-6c7f-4337-a074-220b835ea2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:13.448316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38e3f-aa13-4a2a-815f-9a15d5a0122c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:13.612448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 811/1617] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 14:57:13 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:13.615341 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f05f6f-6c7f-4337-a074-220b835ea2aa None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:13.622094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-31f05f6f-6c7f-4337-a074-220b835ea2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:13.744462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:13.745762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:13.746845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:13.747582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:13.752543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:13.888490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f05f6f-6c7f-4337-a074-220b835ea2aa None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:13.907426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:13.908833 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:13.909617 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:13.914909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:13.923281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:14.018169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:14.028651 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:14.061431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 807/1618] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:13 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:14.062814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:14.085545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5485f-6d40-445b-af4b-760f110dc0ef service nova] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:14.097728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4d298-2707-4124-b866-ccd1140cb301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:14.099339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4d298-2707-4124-b866-ccd1140cb301 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:14.099970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4d298-2707-4124-b866-ccd1140cb301 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:14.101660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4d298-2707-4124-b866-ccd1140cb301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:14.107158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d1e4d298-2707-4124-b866-ccd1140cb301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:14.253269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:14.255897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:14.264247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4d298-2707-4124-b866-ccd1140cb301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:14.266749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4d298-2707-4124-b866-ccd1140cb301 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:14.280310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 808/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:14.294289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4098-603c-4522-ad8a-d0a7953b1235 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:14.295746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4098-603c-4522-ad8a-d0a7953b1235 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:14.296259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4098-603c-4522-ad8a-d0a7953b1235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:14.297435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 812/1620] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:14.299083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:14.304751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:14.338891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-bc7b4098-603c-4522-ad8a-d0a7953b1235 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:14.340150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bc7b4098-603c-4522-ad8a-d0a7953b1235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:14.366562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 809/1621] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:14.506208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcc28f-1f00-47a9-b0e5-d17c102fb20f service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:14.512672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b4098-603c-4522-ad8a-d0a7953b1235 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:14.515373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92f456ee8cf4564aaca2b16f320b49d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:14.515373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:14.515791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bc7b4098-603c-4522-ad8a-d0a7953b1235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:14.515957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:14.516101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:14.538129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:14.540604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:14.563369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 813/1622] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:14 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:14.569886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b4098-603c-4522-ad8a-d0a7953b1235 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:14.586708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:14.589234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:14.589787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:14.591741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:14.618221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:14.622775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:14.647561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 810/1623] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:57:15.331167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:15.334252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:15.361671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091807e-4d82-4bec-a676-a72c9d4ea0d6 service glance] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:15.367022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:15.367943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:15.369835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:15.369835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] PATH_INFO: `/v3/projects/4cff7774374f43209ee9732824e7c503` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:15.369835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cff7774374f43209ee9732824e7c503)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:15.370898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: WARNING py.warnings [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 14:57:15.370898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: warnings.warn(msg) Oct 25 14:57:15.370898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: Oct 25 14:57:15.372637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:15.444582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cff7774374f43209ee9732824e7c503', 'request_id': 'req-eeb39c98-6326-4472-b8a3-e9958e08dd08'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.471438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cff7774374f43209ee9732824e7c503', 'request_id': 'req-eeb39c98-6326-4472-b8a3-e9958e08dd08'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.485888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cff7774374f43209ee9732824e7c503', 'request_id': 'req-eeb39c98-6326-4472-b8a3-e9958e08dd08'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.508800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:15.510234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:15.513649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] The token cache is being invalidate because project 4cff7774374f43209ee9732824e7c503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:57:15.514006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.516072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.522790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 814/1624] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:57:15 2021] DELETE /identity/v3/projects/4cff7774374f43209ee9732824e7c503 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:15.528771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:15.530296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:15.536042 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a09e8-316a-40d1-a708-bdfc1556e80b service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:15.646985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:15.647911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:15.648613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:15.649105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] PATH_INFO: `/v3/projects/4def6089a3ce4a96abe3bc16aa351ab0` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:15.650788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4def6089a3ce4a96abe3bc16aa351ab0)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:15.653942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:15.700228 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb39c98-6326-4472-b8a3-e9958e08dd08 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:15.708933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:15.710911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:15.711630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:15.712167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] PATH_INFO: `/v3/users/2bc1c60abc074989b5cf427a7afba89c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:15.714368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc1c60abc074989b5cf427a7afba89c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:15.718943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:15.734093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4def6089a3ce4a96abe3bc16aa351ab0', 'request_id': 'req-0d60f830-8ebd-4aff-ab6d-db2378e61408'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.741755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4def6089a3ce4a96abe3bc16aa351ab0', 'request_id': 'req-0d60f830-8ebd-4aff-ab6d-db2378e61408'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.753245 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4def6089a3ce4a96abe3bc16aa351ab0', 'request_id': 'req-0d60f830-8ebd-4aff-ab6d-db2378e61408'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.781428 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] The token cache is being invalidate because project 4def6089a3ce4a96abe3bc16aa351ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:57:15.782220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.783658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.786453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 811/1625] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:57:15 2021] DELETE /identity/v3/projects/4def6089a3ce4a96abe3bc16aa351ab0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:15.791849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:15.794387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:15.841760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc1c60abc074989b5cf427a7afba89c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.854775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc1c60abc074989b5cf427a7afba89c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.856624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc1c60abc074989b5cf427a7afba89c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.859268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc1c60abc074989b5cf427a7afba89c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.892073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5473c230-2615-4999-a26e-59e6800f6718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc1c60abc074989b5cf427a7afba89c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:15.920226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60f830-8ebd-4aff-ab6d-db2378e61408 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:15.922525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 815/1626] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:57:15 2021] DELETE /identity/v3/users/2bc1c60abc074989b5cf427a7afba89c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:15.926700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c63aa-03a0-4942-b102-6dcb54d21aed None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:15.927032 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c63aa-03a0-4942-b102-6dcb54d21aed None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:15.927902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c63aa-03a0-4942-b102-6dcb54d21aed None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:15.929687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 816/1627] 10.222.0.57 () {54 vars in 912 bytes} [Mon Oct 25 14:57:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:15.938992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be0825-3ee4-4bb6-ab18-c018c6b82740 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:15.939331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be0825-3ee4-4bb6-ab18-c018c6b82740 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:15.939669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be0825-3ee4-4bb6-ab18-c018c6b82740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:16.045280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-46be0825-3ee4-4bb6-ab18-c018c6b82740 None None] MFA Rules not processed for user `b7a70a0361b648d6a4233546a1d4901d`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:16.045566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-46be0825-3ee4-4bb6-ab18-c018c6b82740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:16.061206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:16.062160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:16.062481 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:16.062760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] PATH_INFO: `/v3/users/babaf77103f14896ab7c8cb4996fa346` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:16.064697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=babaf77103f14896ab7c8cb4996fa346)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:16.066987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:16.152388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 817/1628] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 14:57:15 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:57:16.163039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babaf77103f14896ab7c8cb4996fa346'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:16.174551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babaf77103f14896ab7c8cb4996fa346'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:16.175386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babaf77103f14896ab7c8cb4996fa346'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:16.176460 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babaf77103f14896ab7c8cb4996fa346'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:16.188870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babaf77103f14896ab7c8cb4996fa346'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:16.206615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be0825-3ee4-4bb6-ab18-c018c6b82740 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:16.210161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-46be0825-3ee4-4bb6-ab18-c018c6b82740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:16.215015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 812/1629] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:57:15 2021] DELETE /identity/v3/users/babaf77103f14896ab7c8cb4996fa346 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:16.239048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be0825-3ee4-4bb6-ab18-c018c6b82740 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:16.371815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225a4a8-4ebf-437e-877d-87196a926b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:16.373150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a4a8-4ebf-437e-877d-87196a926b58 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:16.373150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a4a8-4ebf-437e-877d-87196a926b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:16.373150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a4a8-4ebf-437e-877d-87196a926b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:16.375288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c225a4a8-4ebf-437e-877d-87196a926b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:16.390592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225a4a8-4ebf-437e-877d-87196a926b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:16.392103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225a4a8-4ebf-437e-877d-87196a926b58 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:16.402383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 818/1630] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:16 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:16.706929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:16.720348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:17.007588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164f563-795c-4aa2-8f68-d1319b49ccf4 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:17.016783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:17.018633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:17.019448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:17.020080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] PATH_INFO: `/v3/projects/fc6034f27dd94879bff81b03453230c1` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:17.023236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6034f27dd94879bff81b03453230c1)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:17.027477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:17.161162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6034f27dd94879bff81b03453230c1', 'request_id': 'req-f5e49a58-63ee-4008-8c8d-3d79bd07003e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.172161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6034f27dd94879bff81b03453230c1', 'request_id': 'req-f5e49a58-63ee-4008-8c8d-3d79bd07003e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.193129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6034f27dd94879bff81b03453230c1', 'request_id': 'req-f5e49a58-63ee-4008-8c8d-3d79bd07003e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.238600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] The token cache is being invalidate because project fc6034f27dd94879bff81b03453230c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:57:17.239138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.240500 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.243454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 813/1631] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:57:16 2021] DELETE /identity/v3/projects/fc6034f27dd94879bff81b03453230c1 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:57:17.253664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40cc11-5b2e-4b59-90af-0bf3b93036c4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:17.254177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40cc11-5b2e-4b59-90af-0bf3b93036c4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:17.254710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40cc11-5b2e-4b59-90af-0bf3b93036c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:17.295020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-3f40cc11-5b2e-4b59-90af-0bf3b93036c4 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:17.296306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3f40cc11-5b2e-4b59-90af-0bf3b93036c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:17.395735 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:17.402076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:17.452039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 819/1632] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:17.463580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e49a58-63ee-4008-8c8d-3d79bd07003e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:17.471788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630220ca-3953-42ad-b825-ef7232f8a44c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:17.472017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630220ca-3953-42ad-b825-ef7232f8a44c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:17.477286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630220ca-3953-42ad-b825-ef7232f8a44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:17.482330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:17.484076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:17.484650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:17.487226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] PATH_INFO: `/v3/projects/3a9810c0a7924973bc94af80b227f0b8` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:17.493765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9810c0a7924973bc94af80b227f0b8)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:17.501226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:17.561867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-630220ca-3953-42ad-b825-ef7232f8a44c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:17.563347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-630220ca-3953-42ad-b825-ef7232f8a44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:17.599089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 820/1633] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:17.601991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630220ca-3953-42ad-b825-ef7232f8a44c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:17.622345 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630220ca-3953-42ad-b825-ef7232f8a44c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:17.647361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:17.648722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:17.649380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:17.649995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:17.651982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:17.652868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:17.656017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:17.678662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 821/1634] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:17.680752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:17.685403 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9810c0a7924973bc94af80b227f0b8', 'request_id': 'req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.687291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:17.692896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9810c0a7924973bc94af80b227f0b8', 'request_id': 'req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.708255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9810c0a7924973bc94af80b227f0b8', 'request_id': 'req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.719817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d83e-4076-406c-868f-ad9c0e00416c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:17.740891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] The token cache is being invalidate because project 3a9810c0a7924973bc94af80b227f0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:57:17.741725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.743476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.748931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 814/1635] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:57:17 2021] DELETE /identity/v3/projects/3a9810c0a7924973bc94af80b227f0b8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:17.755541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:17.759378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:17.875530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:17.877753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:17.878489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:17.879189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] PATH_INFO: `/v3/projects/13756a3a34f54427a120b9e464bd7c42` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:17.881836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13756a3a34f54427a120b9e464bd7c42)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:17.887329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:17.974873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13756a3a34f54427a120b9e464bd7c42', 'request_id': 'req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.976382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5101fc-1208-4a4a-9351-1e5ab5aa1338 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:17.982515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13756a3a34f54427a120b9e464bd7c42', 'request_id': 'req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:17.992625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13756a3a34f54427a120b9e464bd7c42', 'request_id': 'req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:18.018177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] The token cache is being invalidate because project 13756a3a34f54427a120b9e464bd7c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:57:18.018177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:18.018687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7f7f9e56-440d-486e-bae2-1fb02f4b1f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:18.031337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 822/1636] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:57:17 2021] DELETE /identity/v3/projects/13756a3a34f54427a120b9e464bd7c42 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:18.031337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4600c3-fdeb-4f6b-aee3-1fda65d4f742 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.031337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4600c3-fdeb-4f6b-aee3-1fda65d4f742 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.031337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4600c3-fdeb-4f6b-aee3-1fda65d4f742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.066761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-3b4600c3-fdeb-4f6b-aee3-1fda65d4f742 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:18.067949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3b4600c3-fdeb-4f6b-aee3-1fda65d4f742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:18.143993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96f89-5699-4642-a6e6-3f99acccff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:18.144617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96f89-5699-4642-a6e6-3f99acccff44 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.144900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96f89-5699-4642-a6e6-3f99acccff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.145177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96f89-5699-4642-a6e6-3f99acccff44 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.146031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c96f89-5699-4642-a6e6-3f99acccff44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:18.148088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c96f89-5699-4642-a6e6-3f99acccff44 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:18.199427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 815/1637] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:17 2021] POST /identity/v3/projects => generated 361 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:18.209204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192249f-15be-4171-a2a3-24f3b0357c53 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.209502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192249f-15be-4171-a2a3-24f3b0357c53 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.209801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192249f-15be-4171-a2a3-24f3b0357c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.278871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d192249f-15be-4171-a2a3-24f3b0357c53 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:18.288521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d192249f-15be-4171-a2a3-24f3b0357c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:18.323489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 823/1638] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:18.324599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4600c3-fdeb-4f6b-aee3-1fda65d4f742 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:18.325987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3b4600c3-fdeb-4f6b-aee3-1fda65d4f742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:18.339041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4600c3-fdeb-4f6b-aee3-1fda65d4f742 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:18.430794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98364572-8b78-42a2-ac4f-fded3399b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:18.431436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364572-8b78-42a2-ac4f-fded3399b6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.432378 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364572-8b78-42a2-ac4f-fded3399b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.432686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364572-8b78-42a2-ac4f-fded3399b6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.433357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98364572-8b78-42a2-ac4f-fded3399b6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:18.435629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98364572-8b78-42a2-ac4f-fded3399b6e2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:18.469850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 824/1639] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:18 2021] POST /identity/v3/users => generated 281 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:18.469850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e85fff-7636-4928-84ab-585342fe3bdc None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.469850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e85fff-7636-4928-84ab-585342fe3bdc None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.469850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e85fff-7636-4928-84ab-585342fe3bdc None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.472735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 825/1640] 10.222.0.57 () {54 vars in 912 bytes} [Mon Oct 25 14:57:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:18.479181 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76f23b-619a-4d72-848c-76ba499602c8 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.479478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76f23b-619a-4d72-848c-76ba499602c8 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.479767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76f23b-619a-4d72-848c-76ba499602c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.508638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5f76f23b-619a-4d72-848c-76ba499602c8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:18.509987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5f76f23b-619a-4d72-848c-76ba499602c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:18.524135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 826/1641] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:18.524135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76f23b-619a-4d72-848c-76ba499602c8 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:18.535403 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76f23b-619a-4d72-848c-76ba499602c8 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:18.545021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e12e-73dd-4ce1-852a-2a7d1933a289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:18.545832 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e12e-73dd-4ce1-852a-2a7d1933a289 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.546271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e12e-73dd-4ce1-852a-2a7d1933a289 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.546611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e12e-73dd-4ce1-852a-2a7d1933a289 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.548146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81e12e-73dd-4ce1-852a-2a7d1933a289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:18.548615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 816/1642] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:18.549919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81e12e-73dd-4ce1-852a-2a7d1933a289 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:18.556589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d127-4746-419b-8fdb-ba7b7c591e72 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.560436 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d127-4746-419b-8fdb-ba7b7c591e72 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.562697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d127-4746-419b-8fdb-ba7b7c591e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.562857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 827/1643] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:18.563669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e12e-73dd-4ce1-852a-2a7d1933a289 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:18.575384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e12e-73dd-4ce1-852a-2a7d1933a289 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:18.581111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:18.581861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.582158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.582525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.583200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:18.583507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:18.585277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:18.603498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 828/1644] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:18.604517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:18.619090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1ab4-1665-43db-8b98-45c55cd9f4aa admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:18.622628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-b302d127-4746-419b-8fdb-ba7b7c591e72 None None] MFA Rules not processed for user `b7a70a0361b648d6a4233546a1d4901d`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:18.624621 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139caefd-0359-493e-a646-7efb191f3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:18.624842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b302d127-4746-419b-8fdb-ba7b7c591e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:18.625433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139caefd-0359-493e-a646-7efb191f3a99 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.625732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139caefd-0359-493e-a646-7efb191f3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.626084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139caefd-0359-493e-a646-7efb191f3a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.627250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139caefd-0359-493e-a646-7efb191f3a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:18.628929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139caefd-0359-493e-a646-7efb191f3a99 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:18.656049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 829/1645] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:18.657864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b83aa-c891-4c10-926e-112fcc921a0b None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.658553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b83aa-c891-4c10-926e-112fcc921a0b None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.658997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b83aa-c891-4c10-926e-112fcc921a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.689341 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-895b83aa-c891-4c10-926e-112fcc921a0b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:18.690562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-895b83aa-c891-4c10-926e-112fcc921a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:18.712417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 830/1646] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:18.713432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b83aa-c891-4c10-926e-112fcc921a0b None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:18.725820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b83aa-c891-4c10-926e-112fcc921a0b None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:18.731206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f7f50-43b4-4400-8d4c-45175b6c870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:18.731888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f7f50-43b4-4400-8d4c-45175b6c870f admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:18.732154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f7f50-43b4-4400-8d4c-45175b6c870f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:18.732599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f7f50-43b4-4400-8d4c-45175b6c870f admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:18.733530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f7f50-43b4-4400-8d4c-45175b6c870f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:18.735889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f7f50-43b4-4400-8d4c-45175b6c870f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:18.779446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 831/1647] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:18 2021] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:18.781605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f7f50-43b4-4400-8d4c-45175b6c870f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:18.802074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 817/1648] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 14:57:18 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:18.803253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302d127-4746-419b-8fdb-ba7b7c591e72 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:18.837879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302d127-4746-419b-8fdb-ba7b7c591e72 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.014899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.015617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.015879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.016200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.016978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:19.017293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.019030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.026977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f7f50-43b4-4400-8d4c-45175b6c870f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.037738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 818/1649] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:57:19.038730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.052399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84848d7b-e12c-4244-a06a-3fae261ff49c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.057343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.058073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.058367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.059797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.060468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.062817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.063490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758d34-5265-4e96-a9ba-70ab5780c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.069518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758d34-5265-4e96-a9ba-70ab5780c178 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.073703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758d34-5265-4e96-a9ba-70ab5780c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.075433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758d34-5265-4e96-a9ba-70ab5780c178 admin admin] PATH_INFO: `/v3/projects/088f36855be84595b9efb29342649229/users/cfb07c50e34a4608a5d8a79868b5cb6a/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.091048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 819/1650] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:19 2021] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:19.092192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.094471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:19.112374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7758d34-5265-4e96-a9ba-70ab5780c178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088f36855be84595b9efb29342649229, user_id=cfb07c50e34a4608a5d8a79868b5cb6a, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.115290 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7758d34-5265-4e96-a9ba-70ab5780c178 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.150441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 832/1651] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:18 2021] PUT /identity/v3/projects/088f36855be84595b9efb29342649229/users/cfb07c50e34a4608a5d8a79868b5cb6a/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:19.150441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758d34-5265-4e96-a9ba-70ab5780c178 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.192562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c5eb-8bdb-43a3-982d-50f5f659ef28 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.256473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758d34-5265-4e96-a9ba-70ab5780c178 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.262732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bff7d2-1b5d-4ac3-afae-13266710d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.263808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff7d2-1b5d-4ac3-afae-13266710d6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.264335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff7d2-1b5d-4ac3-afae-13266710d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.264933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff7d2-1b5d-4ac3-afae-13266710d6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.265693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bff7d2-1b5d-4ac3-afae-13266710d6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.268198 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bff7d2-1b5d-4ac3-afae-13266710d6e7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.306683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 833/1652] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:19 2021] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:19.310935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27ba5-7cf7-470b-9b75-52b17ab2579a None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.311693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27ba5-7cf7-470b-9b75-52b17ab2579a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.312137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27ba5-7cf7-470b-9b75-52b17ab2579a None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.315519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 834/1653] 10.222.0.57 () {54 vars in 960 bytes} [Mon Oct 25 14:57:19 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:19.317270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27ba5-7cf7-470b-9b75-52b17ab2579a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.322316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acbefd-e627-46e8-845c-dc90cdf03b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.322899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acbefd-e627-46e8-845c-dc90cdf03b75 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.323185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acbefd-e627-46e8-845c-dc90cdf03b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.323468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acbefd-e627-46e8-845c-dc90cdf03b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.335505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acbefd-e627-46e8-845c-dc90cdf03b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.337693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acbefd-e627-46e8-845c-dc90cdf03b75 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.352338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 820/1654] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:19 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:19.353978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4d11a-a456-495c-9c01-cd2687a788ef None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.354320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4d11a-a456-495c-9c01-cd2687a788ef None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.354653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4d11a-a456-495c-9c01-cd2687a788ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.401877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-96b4d11a-a456-495c-9c01-cd2687a788ef None None] MFA Rules not processed for user `cfb07c50e34a4608a5d8a79868b5cb6a`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:19.403319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-96b4d11a-a456-495c-9c01-cd2687a788ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:19.471988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27ba5-7cf7-470b-9b75-52b17ab2579a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.481570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09a75-be7c-496f-bca1-1774ef3c7c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.482616 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09a75-be7c-496f-bca1-1774ef3c7c72 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.483370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09a75-be7c-496f-bca1-1774ef3c7c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.483847 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09a75-be7c-496f-bca1-1774ef3c7c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.485087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09a75-be7c-496f-bca1-1774ef3c7c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.488084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09a75-be7c-496f-bca1-1774ef3c7c72 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.510769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 835/1655] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:19 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:19.512405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09a75-be7c-496f-bca1-1774ef3c7c72 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.531285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09a75-be7c-496f-bca1-1774ef3c7c72 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.541588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 821/1656] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:19 2021] POST /identity/v3/auth/tokens => generated 3668 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:19.543844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051cc36-4887-43e1-bd95-1539075513d9 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.544193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051cc36-4887-43e1-bd95-1539075513d9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.544717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051cc36-4887-43e1-bd95-1539075513d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.547704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cccbe1-5a11-4037-9560-57efe6646f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.549351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccbe1-5a11-4037-9560-57efe6646f00 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.564968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccbe1-5a11-4037-9560-57efe6646f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.565957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccbe1-5a11-4037-9560-57efe6646f00 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.571773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cccbe1-5a11-4037-9560-57efe6646f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.576302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cccbe1-5a11-4037-9560-57efe6646f00 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.641575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-9051cc36-4887-43e1-bd95-1539075513d9 None None] MFA Rules not processed for user `eca65349f42a4b53aa051474cd1c98d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:19.643966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9051cc36-4887-43e1-bd95-1539075513d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:19.688614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 836/1657] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:19 2021] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:19.688614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cccbe1-5a11-4037-9560-57efe6646f00 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.742252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cccbe1-5a11-4037-9560-57efe6646f00 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.762495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80ac1a-958f-4495-83d8-e5593503bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.763875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ac1a-958f-4495-83d8-e5593503bac4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.764410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ac1a-958f-4495-83d8-e5593503bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.767208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ac1a-958f-4495-83d8-e5593503bac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.768608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80ac1a-958f-4495-83d8-e5593503bac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.775820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80ac1a-958f-4495-83d8-e5593503bac4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.816270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 837/1658] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:19 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:19.817398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80ac1a-958f-4495-83d8-e5593503bac4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.844169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80ac1a-958f-4495-83d8-e5593503bac4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:19.859476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9426e73-537b-41d6-b453-a0c77d2bea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:19.860005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9426e73-537b-41d6-b453-a0c77d2bea83 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:19.860291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9426e73-537b-41d6-b453-a0c77d2bea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:19.860572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9426e73-537b-41d6-b453-a0c77d2bea83 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:19.861225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9426e73-537b-41d6-b453-a0c77d2bea83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:19.863214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9426e73-537b-41d6-b453-a0c77d2bea83 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:19.896992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 822/1659] 10.222.0.57 () {58 vars in 1057 bytes} [Mon Oct 25 14:57:19 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:19.898756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051cc36-4887-43e1-bd95-1539075513d9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.917274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 838/1660] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:19 2021] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:19.917274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9426e73-537b-41d6-b453-a0c77d2bea83 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:19.940186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051cc36-4887-43e1-bd95-1539075513d9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.068206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9426e73-537b-41d6-b453-a0c77d2bea83 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.073623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf2f6-fdda-4fdd-a85a-d1c5b8f5e7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:20.075652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf2f6-fdda-4fdd-a85a-d1c5b8f5e7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.075945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf2f6-fdda-4fdd-a85a-d1c5b8f5e7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.076913 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf2f6-fdda-4fdd-a85a-d1c5b8f5e7d5 admin admin] PATH_INFO: `/v3/projects/8972fc79b7de48839f5212bfcc90b1a6/users/a582e1b955a441538ab6b9a8d2342c1b/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.104688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf2f6-fdda-4fdd-a85a-d1c5b8f5e7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8972fc79b7de48839f5212bfcc90b1a6, user_id=a582e1b955a441538ab6b9a8d2342c1b, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:20.108684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf2f6-fdda-4fdd-a85a-d1c5b8f5e7d5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:20.134750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e781f-360e-4a07-bd81-fb5fd8291eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:20.136021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 839/1661] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:19 2021] PUT /identity/v3/projects/8972fc79b7de48839f5212bfcc90b1a6/users/a582e1b955a441538ab6b9a8d2342c1b/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:20.146755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e781f-360e-4a07-bd81-fb5fd8291eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.147711 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e781f-360e-4a07-bd81-fb5fd8291eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.148513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e781f-360e-4a07-bd81-fb5fd8291eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.150202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e781f-360e-4a07-bd81-fb5fd8291eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:20.150554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf2f6-fdda-4fdd-a85a-d1c5b8f5e7d5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:20.157473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e781f-360e-4a07-bd81-fb5fd8291eb9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:20.206438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 823/1662] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:19 2021] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:20.209004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e781f-360e-4a07-bd81-fb5fd8291eb9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:20.250182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e781f-360e-4a07-bd81-fb5fd8291eb9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.307712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf2f6-fdda-4fdd-a85a-d1c5b8f5e7d5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.316872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd406935-6427-442a-a1b0-bc976c40aa97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:20.318365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406935-6427-442a-a1b0-bc976c40aa97 service placement] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.318960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406935-6427-442a-a1b0-bc976c40aa97 service placement] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.320871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406935-6427-442a-a1b0-bc976c40aa97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.324669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bd406935-6427-442a-a1b0-bc976c40aa97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:20.368862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd406935-6427-442a-a1b0-bc976c40aa97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:20.375179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd406935-6427-442a-a1b0-bc976c40aa97 service placement] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:20.383978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cea22-50e4-4810-8606-59d238ef060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:20.385395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cea22-50e4-4810-8606-59d238ef060a admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.386118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cea22-50e4-4810-8606-59d238ef060a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.388535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cea22-50e4-4810-8606-59d238ef060a admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.390563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cea22-50e4-4810-8606-59d238ef060a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:20.395002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cea22-50e4-4810-8606-59d238ef060a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:20.398624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 840/1663] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:20 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:20.400139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f681-1426-44bd-b4e6-9789e05e2585 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.400622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f681-1426-44bd-b4e6-9789e05e2585 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.401009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f681-1426-44bd-b4e6-9789e05e2585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.448837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-9525f681-1426-44bd-b4e6-9789e05e2585 None None] MFA Rules not processed for user `a582e1b955a441538ab6b9a8d2342c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:20.451086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9525f681-1426-44bd-b4e6-9789e05e2585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:20.466555 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 824/1664] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:20 2021] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:20.468759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cea22-50e4-4810-8606-59d238ef060a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:20.495728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cea22-50e4-4810-8606-59d238ef060a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.508830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9c879-1da0-4a78-9f4c-b122c81d3a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:20.511200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c879-1da0-4a78-9f4c-b122c81d3a18 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.512601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c879-1da0-4a78-9f4c-b122c81d3a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.513340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c879-1da0-4a78-9f4c-b122c81d3a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.515143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9c879-1da0-4a78-9f4c-b122c81d3a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:20.519034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9c879-1da0-4a78-9f4c-b122c81d3a18 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:20.552752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 825/1665] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:20 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:20.555068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9c879-1da0-4a78-9f4c-b122c81d3a18 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:20.578991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9c879-1da0-4a78-9f4c-b122c81d3a18 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.585905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 841/1666] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:20 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:20.587481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f681-1426-44bd-b4e6-9789e05e2585 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:20.595696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afbc77-3cab-4bb8-9ceb-48943a3ec2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:20.596741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afbc77-3cab-4bb8-9ceb-48943a3ec2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.597258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afbc77-3cab-4bb8-9ceb-48943a3ec2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.597791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afbc77-3cab-4bb8-9ceb-48943a3ec2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.600055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afbc77-3cab-4bb8-9ceb-48943a3ec2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:20.603526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afbc77-3cab-4bb8-9ceb-48943a3ec2b1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:20.604631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f681-1426-44bd-b4e6-9789e05e2585 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.612003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f54696-0f6a-4416-b180-4c62a1f716e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:20.613723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f54696-0f6a-4416-b180-4c62a1f716e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.614257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f54696-0f6a-4416-b180-4c62a1f716e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.614969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f54696-0f6a-4416-b180-4c62a1f716e6 admin admin] PATH_INFO: `/v3/projects/ae5c7f3eae8d4f65903e599c4a20b28a/users/2621df5c30da4ea5aec35a5f3186e13a/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.628267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 826/1667] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:20 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:20.630930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afbc77-3cab-4bb8-9ceb-48943a3ec2b1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:20.646446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f54696-0f6a-4416-b180-4c62a1f716e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5c7f3eae8d4f65903e599c4a20b28a, user_id=2621df5c30da4ea5aec35a5f3186e13a, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:20.651742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f54696-0f6a-4416-b180-4c62a1f716e6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:20.652504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afbc77-3cab-4bb8-9ceb-48943a3ec2b1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.662535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3801b0-5861-435b-8012-844facdd1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:20.663806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3801b0-5861-435b-8012-844facdd1347 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.664327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3801b0-5861-435b-8012-844facdd1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.665171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3801b0-5861-435b-8012-844facdd1347 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.666470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3801b0-5861-435b-8012-844facdd1347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:20.671285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3801b0-5861-435b-8012-844facdd1347 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:20.675125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 842/1668] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:20 2021] PUT /identity/v3/projects/ae5c7f3eae8d4f65903e599c4a20b28a/users/2621df5c30da4ea5aec35a5f3186e13a/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:20.676688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f54696-0f6a-4416-b180-4c62a1f716e6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:20.733150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 827/1669] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:20 2021] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:20.733150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8d8f-2e0e-461c-9c65-2f8ae6855ede None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:20.733150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8d8f-2e0e-461c-9c65-2f8ae6855ede None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:20.733150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8d8f-2e0e-461c-9c65-2f8ae6855ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:20.797424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-943d8d8f-2e0e-461c-9c65-2f8ae6855ede None None] MFA Rules not processed for user `2621df5c30da4ea5aec35a5f3186e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:20.801208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-943d8d8f-2e0e-461c-9c65-2f8ae6855ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:20.865115 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f54696-0f6a-4416-b180-4c62a1f716e6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:20.981571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 828/1670] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:20 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:20.981571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8d8f-2e0e-461c-9c65-2f8ae6855ede None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:21.144839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8d8f-2e0e-461c-9c65-2f8ae6855ede None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:21.147142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:21.148842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:21.149549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:21.150223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] PATH_INFO: `/v3/projects/31164bf256a24f4bbd369994a520419d/users/6fbf2fbb0b084fa78a8542b72254f827/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:21.150449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7a150-4e86-4494-8485-66e77a52de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:21.151012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7a150-4e86-4494-8485-66e77a52de27 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:21.151303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7a150-4e86-4494-8485-66e77a52de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:21.151635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7a150-4e86-4494-8485-66e77a52de27 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:21.152817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7a150-4e86-4494-8485-66e77a52de27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:21.155205 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7a150-4e86-4494-8485-66e77a52de27 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:21.188670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 829/1671] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:20 2021] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:21.190567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7a150-4e86-4494-8485-66e77a52de27 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:21.205130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31164bf256a24f4bbd369994a520419d, user_id=6fbf2fbb0b084fa78a8542b72254f827, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:21.216993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7a150-4e86-4494-8485-66e77a52de27 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:21.223366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:21.230090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47d4f0-fb9c-42e8-9ec4-bd410ae8399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:21.231782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d4f0-fb9c-42e8-9ec4-bd410ae8399e admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:21.232318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d4f0-fb9c-42e8-9ec4-bd410ae8399e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:21.233637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d4f0-fb9c-42e8-9ec4-bd410ae8399e admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:21.238646 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47d4f0-fb9c-42e8-9ec4-bd410ae8399e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:21.247351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47d4f0-fb9c-42e8-9ec4-bd410ae8399e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:21.291809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 843/1672] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:20 2021] PUT /identity/v3/projects/31164bf256a24f4bbd369994a520419d/users/6fbf2fbb0b084fa78a8542b72254f827/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:21.299547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:21.304118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:21.486302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3ab29-0d84-4640-bd44-a4256ea0c617 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:21.500885 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:21.501921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:21.501921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:21.502249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:21.508054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:21.535290 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:21.540562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:21.568411 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 844/1673] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:21 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:21.569116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:21.642602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 830/1674] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:21 2021] POST /identity/v3/projects => generated 375 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:21.644480 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47d4f0-fb9c-42e8-9ec4-bd410ae8399e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:21.745083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884578f-a26d-4d4b-b1c2-9cb53e772e8e service placement] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:21.963263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e558d5-fbad-4c68-a80b-ee2439e5206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:21.963996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e558d5-fbad-4c68-a80b-ee2439e5206f admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:21.964260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e558d5-fbad-4c68-a80b-ee2439e5206f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:21.964547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e558d5-fbad-4c68-a80b-ee2439e5206f admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:21.968673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e558d5-fbad-4c68-a80b-ee2439e5206f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:21.974207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47d4f0-fb9c-42e8-9ec4-bd410ae8399e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:21.975025 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e558d5-fbad-4c68-a80b-ee2439e5206f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:21.998682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d082ec-90a7-4a81-b4e0-fc57f74fc43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:22.000124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d082ec-90a7-4a81-b4e0-fc57f74fc43b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:22.000635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d082ec-90a7-4a81-b4e0-fc57f74fc43b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:22.001128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d082ec-90a7-4a81-b4e0-fc57f74fc43b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:22.002876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d082ec-90a7-4a81-b4e0-fc57f74fc43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:22.006048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d082ec-90a7-4a81-b4e0-fc57f74fc43b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:22.014016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 845/1675] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:21 2021] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:22.014945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e558d5-fbad-4c68-a80b-ee2439e5206f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:22.053278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 831/1676] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:21 2021] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:22.053278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d082ec-90a7-4a81-b4e0-fc57f74fc43b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:22.055198 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e558d5-fbad-4c68-a80b-ee2439e5206f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:22.067440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fc064-7072-4507-811c-2c43187ea0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:22.068074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fc064-7072-4507-811c-2c43187ea0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:22.068370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fc064-7072-4507-811c-2c43187ea0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:22.068657 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fc064-7072-4507-811c-2c43187ea0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:22.069339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fc064-7072-4507-811c-2c43187ea0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:22.077928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fc064-7072-4507-811c-2c43187ea0e4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:22.085916 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d082ec-90a7-4a81-b4e0-fc57f74fc43b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:22.109126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e6cb7-2f47-441b-9c01-8f2b34e59b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:22.110713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6cb7-2f47-441b-9c01-8f2b34e59b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:22.111175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6cb7-2f47-441b-9c01-8f2b34e59b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:22.111657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6cb7-2f47-441b-9c01-8f2b34e59b88 admin admin] PATH_INFO: `/v3/projects/d429378b8bd04bbe8f1b8384cfea8c1f/users/b6059776e305445eb9589f69070d4e1a/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:22.149930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 846/1677] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:22 2021] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:22.149930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fc064-7072-4507-811c-2c43187ea0e4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:22.192048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fc064-7072-4507-811c-2c43187ea0e4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:22.215358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb93be-49a5-4dee-9d66-beb17183e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:22.217104 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e6cb7-2f47-441b-9c01-8f2b34e59b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d429378b8bd04bbe8f1b8384cfea8c1f, user_id=b6059776e305445eb9589f69070d4e1a, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:22.218714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb93be-49a5-4dee-9d66-beb17183e3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:22.221971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb93be-49a5-4dee-9d66-beb17183e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:22.222709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb93be-49a5-4dee-9d66-beb17183e3ca admin admin] PATH_INFO: `/v3/projects/31164bf256a24f4bbd369994a520419d/users/6fbf2fbb0b084fa78a8542b72254f827/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:22.228927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e6cb7-2f47-441b-9c01-8f2b34e59b88 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:22.229647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb93be-49a5-4dee-9d66-beb17183e3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=31164bf256a24f4bbd369994a520419d, user_id=6fbf2fbb0b084fa78a8542b72254f827, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:22.238547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb93be-49a5-4dee-9d66-beb17183e3ca admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:22.288474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 847/1678] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:22 2021] PUT /identity/v3/projects/31164bf256a24f4bbd369994a520419d/users/6fbf2fbb0b084fa78a8542b72254f827/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:22.289529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb93be-49a5-4dee-9d66-beb17183e3ca admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:22.337325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 832/1679] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:22 2021] PUT /identity/v3/projects/d429378b8bd04bbe8f1b8384cfea8c1f/users/b6059776e305445eb9589f69070d4e1a/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:22.345440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e6cb7-2f47-441b-9c01-8f2b34e59b88 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:22.549295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb93be-49a5-4dee-9d66-beb17183e3ca admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:22.580373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586135ae-bf2e-4059-b4a1-43fd4930174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:22.581239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586135ae-bf2e-4059-b4a1-43fd4930174d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:22.581878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586135ae-bf2e-4059-b4a1-43fd4930174d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:22.582346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586135ae-bf2e-4059-b4a1-43fd4930174d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:22.583367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586135ae-bf2e-4059-b4a1-43fd4930174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:22.585292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586135ae-bf2e-4059-b4a1-43fd4930174d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:22.622127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e6cb7-2f47-441b-9c01-8f2b34e59b88 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:22.622912 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 848/1680] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:22 2021] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:22.630173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3692-7651-4aa7-a311-7388de41dd26 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:22.630803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3692-7651-4aa7-a311-7388de41dd26 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:22.631396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3692-7651-4aa7-a311-7388de41dd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:22.640507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957a6a-a7af-4d5b-a135-fc06e8ee56fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:22.642087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957a6a-a7af-4d5b-a135-fc06e8ee56fc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:22.643627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957a6a-a7af-4d5b-a135-fc06e8ee56fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:22.644096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957a6a-a7af-4d5b-a135-fc06e8ee56fc admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:22.645092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80957a6a-a7af-4d5b-a135-fc06e8ee56fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:22.648048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80957a6a-a7af-4d5b-a135-fc06e8ee56fc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:22.671795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 833/1681] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:22 2021] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:57:22.673677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957a6a-a7af-4d5b-a135-fc06e8ee56fc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:22.743915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957a6a-a7af-4d5b-a135-fc06e8ee56fc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:22.767634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d596737-8621-437f-b9ea-1f969d66dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:22.768550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596737-8621-437f-b9ea-1f969d66dacb admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:22.768844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596737-8621-437f-b9ea-1f969d66dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:22.769145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596737-8621-437f-b9ea-1f969d66dacb admin admin] PATH_INFO: `/v3/projects/a88463824ab84410be2ddd1b9e68d50c/users/39d8d8abca7d46559b029febffebf5a2/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:22.839354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5a3b3692-7651-4aa7-a311-7388de41dd26 None None] MFA Rules not processed for user `6fbf2fbb0b084fa78a8542b72254f827`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:22.842535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5a3b3692-7651-4aa7-a311-7388de41dd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:22.895589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d596737-8621-437f-b9ea-1f969d66dacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88463824ab84410be2ddd1b9e68d50c, user_id=39d8d8abca7d46559b029febffebf5a2, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:22.908184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d596737-8621-437f-b9ea-1f969d66dacb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:22.979404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 834/1682] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:22 2021] PUT /identity/v3/projects/a88463824ab84410be2ddd1b9e68d50c/users/39d8d8abca7d46559b029febffebf5a2/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:22.984419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d596737-8621-437f-b9ea-1f969d66dacb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:23.228067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d596737-8621-437f-b9ea-1f969d66dacb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:23.251204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a633f30-0520-482b-88a9-19fd0a41ade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:23.253037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a633f30-0520-482b-88a9-19fd0a41ade4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:23.253845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a633f30-0520-482b-88a9-19fd0a41ade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:23.254590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a633f30-0520-482b-88a9-19fd0a41ade4 admin admin] PATH_INFO: `/v3/projects/d429378b8bd04bbe8f1b8384cfea8c1f/users/b6059776e305445eb9589f69070d4e1a/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:23.267201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a633f30-0520-482b-88a9-19fd0a41ade4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d429378b8bd04bbe8f1b8384cfea8c1f, user_id=b6059776e305445eb9589f69070d4e1a, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:23.274646 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a633f30-0520-482b-88a9-19fd0a41ade4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:23.322645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 835/1683] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:22 2021] PUT /identity/v3/projects/d429378b8bd04bbe8f1b8384cfea8c1f/users/b6059776e305445eb9589f69070d4e1a/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:23.325056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f54fe1-1cc7-49f3-bebd-ece7d5604830 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:23.325543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f54fe1-1cc7-49f3-bebd-ece7d5604830 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:23.325963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f54fe1-1cc7-49f3-bebd-ece7d5604830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:23.329886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 849/1684] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:22 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 706 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:23.331590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b3692-7651-4aa7-a311-7388de41dd26 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:23.375018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b3692-7651-4aa7-a311-7388de41dd26 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:23.440645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a6f54fe1-1cc7-49f3-bebd-ece7d5604830 None None] MFA Rules not processed for user `aa6c8c2103534ca28f981d39cecb2c70`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:23.441880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a6f54fe1-1cc7-49f3-bebd-ece7d5604830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:23.698446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93c7e7-c973-4b5e-8993-7a3d1a572490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:23.698446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c7e7-c973-4b5e-8993-7a3d1a572490 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:23.698446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c7e7-c973-4b5e-8993-7a3d1a572490 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:23.698446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c7e7-c973-4b5e-8993-7a3d1a572490 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:23.709036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93c7e7-c973-4b5e-8993-7a3d1a572490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:23.712291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93c7e7-c973-4b5e-8993-7a3d1a572490 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:23.800329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 850/1685] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:23 2021] GET /identity/v3/roles => generated 1420 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:23.810520 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf386a8-e24c-42fb-9323-78549e4e9419 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:23.811101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf386a8-e24c-42fb-9323-78549e4e9419 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:23.816205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf386a8-e24c-42fb-9323-78549e4e9419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:23.874994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 836/1686] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:23 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:23.892248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f54fe1-1cc7-49f3-bebd-ece7d5604830 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:23.895532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a6f54fe1-1cc7-49f3-bebd-ece7d5604830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:23.915463 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-ebf386a8-e24c-42fb-9323-78549e4e9419 None None] MFA Rules not processed for user `b6059776e305445eb9589f69070d4e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:23.919153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ebf386a8-e24c-42fb-9323-78549e4e9419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:24.034733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f54fe1-1cc7-49f3-bebd-ece7d5604830 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:24.039658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf810eea-d41a-40dd-828a-4571e6c0248c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:24.040387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf810eea-d41a-40dd-828a-4571e6c0248c service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:24.041015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf810eea-d41a-40dd-828a-4571e6c0248c service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:24.041396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf810eea-d41a-40dd-828a-4571e6c0248c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:24.079924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 851/1687] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:23 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:24.081185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf386a8-e24c-42fb-9323-78549e4e9419 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:24.106612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf386a8-e24c-42fb-9323-78549e4e9419 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:24.125039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:24.126470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:24.127035 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:24.127534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] PATH_INFO: `/v3/projects/a88463824ab84410be2ddd1b9e68d50c/users/39d8d8abca7d46559b029febffebf5a2/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:24.136232 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88463824ab84410be2ddd1b9e68d50c, user_id=39d8d8abca7d46559b029febffebf5a2, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:24.140153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:24.165757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 852/1688] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:24 2021] PUT /identity/v3/projects/a88463824ab84410be2ddd1b9e68d50c/users/39d8d8abca7d46559b029febffebf5a2/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:24.167257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:24.178995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:24.313441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf810eea-d41a-40dd-828a-4571e6c0248c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:24.315274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf810eea-d41a-40dd-828a-4571e6c0248c service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:24.328855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 837/1689] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:23 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:24.330299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fe743-a030-4676-bb5c-2dfab78077d4 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:24.330705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fe743-a030-4676-bb5c-2dfab78077d4 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:24.330999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fe743-a030-4676-bb5c-2dfab78077d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:24.351706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9506e8c-9988-4939-a101-7afff19a760b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:24.365549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:24.366216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:24.366554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:24.366843 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:24.395417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-269fe743-a030-4676-bb5c-2dfab78077d4 None None] MFA Rules not processed for user `39d8d8abca7d46559b029febffebf5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:24.402969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-269fe743-a030-4676-bb5c-2dfab78077d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:24.481511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:24.481511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:24.504067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 853/1690] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:24 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:24.507132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:24.509548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:24.744510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 838/1691] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:24 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:24.760878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb83ff-c02e-4e1b-8be7-71f87c096a7f service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:24.773642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d85eb-b6a6-4fbc-9ea3-9a6b446e0677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:24.774201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d85eb-b6a6-4fbc-9ea3-9a6b446e0677 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:24.774776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d85eb-b6a6-4fbc-9ea3-9a6b446e0677 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:24.775932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d85eb-b6a6-4fbc-9ea3-9a6b446e0677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:24.890098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fe743-a030-4676-bb5c-2dfab78077d4 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:24.936538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fe743-a030-4676-bb5c-2dfab78077d4 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:24.950247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd11de5-9b45-4480-9333-a4da850cab45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:24.951341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11de5-9b45-4480-9333-a4da850cab45 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:24.951829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11de5-9b45-4480-9333-a4da850cab45 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:24.952981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11de5-9b45-4480-9333-a4da850cab45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:25.045824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d85eb-b6a6-4fbc-9ea3-9a6b446e0677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:25.048685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d85eb-b6a6-4fbc-9ea3-9a6b446e0677 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:25.100960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 854/1692] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:24 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:25.108355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d85eb-b6a6-4fbc-9ea3-9a6b446e0677 service nova] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:25.159726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d85eb-b6a6-4fbc-9ea3-9a6b446e0677 service nova] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:25.179220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f385d4-9996-44fe-86cf-8987e79a5249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:25.179898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f385d4-9996-44fe-86cf-8987e79a5249 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:25.180202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f385d4-9996-44fe-86cf-8987e79a5249 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:25.180828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f385d4-9996-44fe-86cf-8987e79a5249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:25.229828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd11de5-9b45-4480-9333-a4da850cab45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:25.234016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd11de5-9b45-4480-9333-a4da850cab45 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:25.298324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 839/1693] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:24 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:57:25.452954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f385d4-9996-44fe-86cf-8987e79a5249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:25.455170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f385d4-9996-44fe-86cf-8987e79a5249 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:25.492683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 855/1694] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:25 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:26.445549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd11de5-9b45-4480-9333-a4da850cab45 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:26.491992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd11de5-9b45-4480-9333-a4da850cab45 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:26.516897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:26.517883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:26.518676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:26.527229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:26.892267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:26.902016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0892cd-79cf-4985-a03b-f50a0ff62a2f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:26.903403 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0892cd-79cf-4985-a03b-f50a0ff62a2f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:26.904097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0892cd-79cf-4985-a03b-f50a0ff62a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:26.908765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:26.974965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 840/1695] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:26 2021] GET /identity/v3/auth/tokens => generated 3668 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:27.006853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2d0892cd-79cf-4985-a03b-f50a0ff62a2f None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:27.012584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2d0892cd-79cf-4985-a03b-f50a0ff62a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:27.234823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 856/1696] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 14:57:26 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:27.602777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:27.608856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:28.056544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed927c-95f2-4f68-881a-848d5f6b3454 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:28.083745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:28.085319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:28.086032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:28.086758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:28.127876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:28.131096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:28.171938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 841/1697] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 14:57:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 14:57:28.766952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58331bd-d92d-4ab2-95a8-e62496448902 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:28.768063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58331bd-d92d-4ab2-95a8-e62496448902 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:28.768568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58331bd-d92d-4ab2-95a8-e62496448902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:28.874754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b58331bd-d92d-4ab2-95a8-e62496448902 None None] MFA Rules not processed for user `b7a70a0361b648d6a4233546a1d4901d`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:28.893746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b58331bd-d92d-4ab2-95a8-e62496448902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:29.297711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 857/1698] 10.222.0.37 () {58 vars in 1015 bytes} [Mon Oct 25 14:57:28 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:29.322077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:29.326952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:29.390855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5574fad-41b7-4ac4-a3dd-67a1a71be336 service swift] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:29.412815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44c87-e150-4e3a-a865-b6fde43179fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:29.413803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44c87-e150-4e3a-a865-b6fde43179fa service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:29.414314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44c87-e150-4e3a-a865-b6fde43179fa service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:29.414871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44c87-e150-4e3a-a865-b6fde43179fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:29.452749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa44c87-e150-4e3a-a865-b6fde43179fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:29.459667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa44c87-e150-4e3a-a865-b6fde43179fa service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:29.508333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 842/1699] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:29 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:32.932314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903940a4-bd69-4e83-a9f0-49b7ba7e09bb None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:32.932751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903940a4-bd69-4e83-a9f0-49b7ba7e09bb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:32.933055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903940a4-bd69-4e83-a9f0-49b7ba7e09bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:33.061212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-903940a4-bd69-4e83-a9f0-49b7ba7e09bb None None] MFA Rules not processed for user `f770ae4a0a644c12aa9bd1e7860faebf`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:33.062785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-903940a4-bd69-4e83-a9f0-49b7ba7e09bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:33.399235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 858/1700] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:32 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:57:33.419154 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59fba-fed2-4254-b42f-5fd15ab0d2a8 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:33.419687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59fba-fed2-4254-b42f-5fd15ab0d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:33.420053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59fba-fed2-4254-b42f-5fd15ab0d2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:33.477594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-13f59fba-fed2-4254-b42f-5fd15ab0d2a8 None None] MFA Rules not processed for user `f770ae4a0a644c12aa9bd1e7860faebf`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:33.478983 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-13f59fba-fed2-4254-b42f-5fd15ab0d2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:33.500287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 843/1701] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:33 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:33.784875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903940a4-bd69-4e83-a9f0-49b7ba7e09bb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:33.805826 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903940a4-bd69-4e83-a9f0-49b7ba7e09bb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:33.831614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f80fd-8dc8-4973-b6a7-c9617fd9bfee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:33.832509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f80fd-8dc8-4973-b6a7-c9617fd9bfee service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:33.833206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f80fd-8dc8-4973-b6a7-c9617fd9bfee service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:33.833924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f80fd-8dc8-4973-b6a7-c9617fd9bfee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:33.846895 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f80fd-8dc8-4973-b6a7-c9617fd9bfee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:33.849997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f80fd-8dc8-4973-b6a7-c9617fd9bfee service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:33.877621 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 859/1702] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:33 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:35.767248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59fba-fed2-4254-b42f-5fd15ab0d2a8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:35.788611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59fba-fed2-4254-b42f-5fd15ab0d2a8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:35.796886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935745d6-f40a-4b72-aac2-cc6296bc39a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:35.798129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935745d6-f40a-4b72-aac2-cc6296bc39a3 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:35.798817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935745d6-f40a-4b72-aac2-cc6296bc39a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:35.799453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935745d6-f40a-4b72-aac2-cc6296bc39a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:35.828353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935745d6-f40a-4b72-aac2-cc6296bc39a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:35.830791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935745d6-f40a-4b72-aac2-cc6296bc39a3 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:35.866197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 844/1703] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:35 2021] GET /identity/v3/auth/tokens => generated 3749 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:35.992430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330ee0-f8b2-4518-a169-f25e10a3964f None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:35.993982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330ee0-f8b2-4518-a169-f25e10a3964f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:35.994604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330ee0-f8b2-4518-a169-f25e10a3964f None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:35.999415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 860/1704] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 14:57:35 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:36.157489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccd55-9a64-447c-83f4-4d438d8dee89 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:36.158133 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccd55-9a64-447c-83f4-4d438d8dee89 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:36.158653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccd55-9a64-447c-83f4-4d438d8dee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:36.260186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e47ccd55-9a64-447c-83f4-4d438d8dee89 None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:36.268361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e47ccd55-9a64-447c-83f4-4d438d8dee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:36.310961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 845/1705] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 14:57:36 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:57:36.927965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330ee0-f8b2-4518-a169-f25e10a3964f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:36.945543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330ee0-f8b2-4518-a169-f25e10a3964f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:36.952615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7789cf-d410-4a3f-b671-df0d8cbf43e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:36.953464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7789cf-d410-4a3f-b671-df0d8cbf43e9 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:36.953898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7789cf-d410-4a3f-b671-df0d8cbf43e9 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:36.954358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7789cf-d410-4a3f-b671-df0d8cbf43e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:36.965859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7789cf-d410-4a3f-b671-df0d8cbf43e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:36.969555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7789cf-d410-4a3f-b671-df0d8cbf43e9 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:36.997108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 861/1706] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:36 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:37.471956 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edaf4-e4df-46eb-a2e8-8a81d9234a67 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:37.472898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edaf4-e4df-46eb-a2e8-8a81d9234a67 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:37.473490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edaf4-e4df-46eb-a2e8-8a81d9234a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:37.515285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-cb9edaf4-e4df-46eb-a2e8-8a81d9234a67 None None] MFA Rules not processed for user `f770ae4a0a644c12aa9bd1e7860faebf`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:37.519037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-cb9edaf4-e4df-46eb-a2e8-8a81d9234a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:37.531122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 846/1707] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:37 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:57:37.638477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351262b-4cc6-4f7b-89f1-9d830cb4c09b None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:37.638774 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351262b-4cc6-4f7b-89f1-9d830cb4c09b None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:37.639335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351262b-4cc6-4f7b-89f1-9d830cb4c09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:37.689561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-9351262b-4cc6-4f7b-89f1-9d830cb4c09b None None] MFA Rules not processed for user `aa6c8c2103534ca28f981d39cecb2c70`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:37.690911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9351262b-4cc6-4f7b-89f1-9d830cb4c09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:37.701537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 862/1708] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:37 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:45.481787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f226-5483-4b09-9085-7c34cf84a986 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:45.482545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f226-5483-4b09-9085-7c34cf84a986 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:45.483037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f226-5483-4b09-9085-7c34cf84a986 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:45.486193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 847/1709] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 14:57:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:57:45.494660 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bd1c1-3e0a-4ff7-a978-915439438421 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:45.495799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bd1c1-3e0a-4ff7-a978-915439438421 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:45.495799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bd1c1-3e0a-4ff7-a978-915439438421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:45.547302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-4a9bd1c1-3e0a-4ff7-a978-915439438421 None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:45.548672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4a9bd1c1-3e0a-4ff7-a978-915439438421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:45.560998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 863/1710] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 14:57:45 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:45.648675 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4f226-5483-4b09-9085-7c34cf84a986 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:45.650994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-52d4f226-5483-4b09-9085-7c34cf84a986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:45.682248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4f226-5483-4b09-9085-7c34cf84a986 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:45.692909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589724a9-6d7d-468f-afb5-c3b9e890af23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:45.694364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589724a9-6d7d-468f-afb5-c3b9e890af23 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:45.695148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589724a9-6d7d-468f-afb5-c3b9e890af23 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:45.695911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589724a9-6d7d-468f-afb5-c3b9e890af23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:45.708534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589724a9-6d7d-468f-afb5-c3b9e890af23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:45.710446 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589724a9-6d7d-468f-afb5-c3b9e890af23 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:45.723008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 848/1711] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:45 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:48.379841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bd1c1-3e0a-4ff7-a978-915439438421 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:48.381834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4a9bd1c1-3e0a-4ff7-a978-915439438421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:48.683992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bd1c1-3e0a-4ff7-a978-915439438421 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:48.716259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:48.721193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:48.721679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:48.722117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] PATH_INFO: `/v3/users/281d9be71ef046e6a1005830d31c5718` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:48.730471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281d9be71ef046e6a1005830d31c5718)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:48.746251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:48.974081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281d9be71ef046e6a1005830d31c5718'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:48.999441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281d9be71ef046e6a1005830d31c5718'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:49.001465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281d9be71ef046e6a1005830d31c5718'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:49.003334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281d9be71ef046e6a1005830d31c5718'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:49.053648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281d9be71ef046e6a1005830d31c5718'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:49.083524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 864/1712] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:57:48 2021] DELETE /identity/v3/users/281d9be71ef046e6a1005830d31c5718 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:57:49.090852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20dec5-6055-48c2-be48-3e01cba1c580 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:49.091774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20dec5-6055-48c2-be48-3e01cba1c580 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:49.092417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20dec5-6055-48c2-be48-3e01cba1c580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:49.246003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ee20dec5-6055-48c2-be48-3e01cba1c580 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:49.251271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ee20dec5-6055-48c2-be48-3e01cba1c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:49.589403 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 849/1713] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:57:49.694098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:49.697634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:50.026561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23186cca-8c72-4c64-856d-c64cd776d7c1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:50.047153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2726ce4-8274-41f9-b526-6ce3cccb9254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:50.048569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726ce4-8274-41f9-b526-6ce3cccb9254 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:50.049234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726ce4-8274-41f9-b526-6ce3cccb9254 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:50.049737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726ce4-8274-41f9-b526-6ce3cccb9254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:50.087952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2726ce4-8274-41f9-b526-6ce3cccb9254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:50.090859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2726ce4-8274-41f9-b526-6ce3cccb9254 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:50.133796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 865/1714] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:51.814696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20dec5-6055-48c2-be48-3e01cba1c580 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:51.816272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ee20dec5-6055-48c2-be48-3e01cba1c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:51.828640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20dec5-6055-48c2-be48-3e01cba1c580 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:51.833533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:51.834341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:51.834659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:51.834937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] PATH_INFO: `/v3/projects/5f011125854a4b7ab910e581b331cffe` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:51.836104 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f011125854a4b7ab910e581b331cffe)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:51.838113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:51.906726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f011125854a4b7ab910e581b331cffe', 'request_id': 'req-1fc176db-af60-47fb-8f11-3cb8350acd75'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:51.914298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f011125854a4b7ab910e581b331cffe', 'request_id': 'req-1fc176db-af60-47fb-8f11-3cb8350acd75'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:51.926031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f011125854a4b7ab910e581b331cffe', 'request_id': 'req-1fc176db-af60-47fb-8f11-3cb8350acd75'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:51.951154 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] The token cache is being invalidate because project 5f011125854a4b7ab910e581b331cffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:57:51.951910 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:51.952976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fc176db-af60-47fb-8f11-3cb8350acd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:51.955979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 850/1715] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:57:51 2021] DELETE /identity/v3/projects/5f011125854a4b7ab910e581b331cffe => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:57:51.964385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f57b41-695f-4557-aa88-eb78897c2202 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:51.965205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f57b41-695f-4557-aa88-eb78897c2202 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:51.965495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f57b41-695f-4557-aa88-eb78897c2202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.010087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-08f57b41-695f-4557-aa88-eb78897c2202 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:52.012932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-08f57b41-695f-4557-aa88-eb78897c2202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:52.103736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 866/1716] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:52.112574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d665ca-ecce-4b82-a9d2-62619739072d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.113106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d665ca-ecce-4b82-a9d2-62619739072d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.113543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d665ca-ecce-4b82-a9d2-62619739072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.139391 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-05d665ca-ecce-4b82-a9d2-62619739072d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:52.140669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-05d665ca-ecce-4b82-a9d2-62619739072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:52.148588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 851/1717] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:52.153301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f57b41-695f-4557-aa88-eb78897c2202 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:52.163454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f57b41-695f-4557-aa88-eb78897c2202 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:52.168878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:52.169497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.169780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.170057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.170910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:57:52.171227 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:52.172871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:52.191711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 867/1718] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:57:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:57:52.197915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d665ca-ecce-4b82-a9d2-62619739072d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:52.220078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d665ca-ecce-4b82-a9d2-62619739072d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:52.227465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5f8c-59a7-4b3f-bd84-2d451b62dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:52.228088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5f8c-59a7-4b3f-bd84-2d451b62dd12 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.228916 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5f8c-59a7-4b3f-bd84-2d451b62dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.229777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5f8c-59a7-4b3f-bd84-2d451b62dd12 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.230377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce5f8c-59a7-4b3f-bd84-2d451b62dd12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:52.232344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce5f8c-59a7-4b3f-bd84-2d451b62dd12 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:52.278520 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 852/1719] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:52 2021] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:57:52.279124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:52.302476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ad373-637c-4f51-a465-a87263eb8044 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:52.447344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92391bac-76d1-46b1-b0d8-f12a5167ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:52.448616 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391bac-76d1-46b1-b0d8-f12a5167ca61 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.449293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391bac-76d1-46b1-b0d8-f12a5167ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.449770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391bac-76d1-46b1-b0d8-f12a5167ca61 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.450917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391bac-76d1-46b1-b0d8-f12a5167ca61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:52.454734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391bac-76d1-46b1-b0d8-f12a5167ca61 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:52.489429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 868/1720] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:52 2021] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:52.495906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5f8c-59a7-4b3f-bd84-2d451b62dd12 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:52.510222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5f8c-59a7-4b3f-bd84-2d451b62dd12 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:52.517793 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184e778-fb56-4dfd-85a0-aacaad601e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:52.518647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184e778-fb56-4dfd-85a0-aacaad601e76 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.519075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184e778-fb56-4dfd-85a0-aacaad601e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.519554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184e778-fb56-4dfd-85a0-aacaad601e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.520450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184e778-fb56-4dfd-85a0-aacaad601e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:52.522435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184e778-fb56-4dfd-85a0-aacaad601e76 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:52.540687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 853/1721] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:52 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:52.547088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92391bac-76d1-46b1-b0d8-f12a5167ca61 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:52.561622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92391bac-76d1-46b1-b0d8-f12a5167ca61 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:52.567373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0edff9-a7d8-4317-9c4d-83595470545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:52.568207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0edff9-a7d8-4317-9c4d-83595470545b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.568587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0edff9-a7d8-4317-9c4d-83595470545b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.568998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0edff9-a7d8-4317-9c4d-83595470545b admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.569833 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0edff9-a7d8-4317-9c4d-83595470545b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:52.571681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0edff9-a7d8-4317-9c4d-83595470545b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:52.586112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 869/1722] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:52 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:52.593312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184e778-fb56-4dfd-85a0-aacaad601e76 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:52.618153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184e778-fb56-4dfd-85a0-aacaad601e76 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:52.626901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:52.629433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.630021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.630730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] PATH_INFO: `/v3/projects/78515254aa714366b94bbf8fb61b80b4/users/a1dded3d7a0e4bbc9b7cddbac2ef6b43/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.674615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78515254aa714366b94bbf8fb61b80b4, user_id=a1dded3d7a0e4bbc9b7cddbac2ef6b43, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:52.680833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:52.713817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 854/1723] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:52 2021] PUT /identity/v3/projects/78515254aa714366b94bbf8fb61b80b4/users/a1dded3d7a0e4bbc9b7cddbac2ef6b43/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:52.716121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744e4f-345c-4bcf-849f-999a7a2afc92 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.717199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744e4f-345c-4bcf-849f-999a7a2afc92 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.717931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744e4f-345c-4bcf-849f-999a7a2afc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.759499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-10744e4f-345c-4bcf-849f-999a7a2afc92 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:52.761492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-10744e4f-345c-4bcf-849f-999a7a2afc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:52.878213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 870/1724] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:52.889957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:52.891953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:52.971038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0582-b4a9-49e7-8084-cd124348c8a8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:52.977309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b62bc-3dd9-4681-93eb-29251fe26675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:52.978564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b62bc-3dd9-4681-93eb-29251fe26675 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:52.978895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b62bc-3dd9-4681-93eb-29251fe26675 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:52.979882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b62bc-3dd9-4681-93eb-29251fe26675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:52.998334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b62bc-3dd9-4681-93eb-29251fe26675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:53.001168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b62bc-3dd9-4681-93eb-29251fe26675 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:53.019146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 855/1725] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:55.652359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044f58b-3206-4dbd-9c0b-87b9bedacda2 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:55.653314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044f58b-3206-4dbd-9c0b-87b9bedacda2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:55.653582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044f58b-3206-4dbd-9c0b-87b9bedacda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:55.709323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0044f58b-3206-4dbd-9c0b-87b9bedacda2 None None] MFA Rules not processed for user `a1dded3d7a0e4bbc9b7cddbac2ef6b43`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:55.711087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0044f58b-3206-4dbd-9c0b-87b9bedacda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:55.973449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 871/1726] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:55 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:57:55.978493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b62bc-3dd9-4681-93eb-29251fe26675 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:55.991177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b62bc-3dd9-4681-93eb-29251fe26675 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:56.009531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c970-b008-4bcf-9076-75155bcb4f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:56.010643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c970-b008-4bcf-9076-75155bcb4f24 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:56.011135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c970-b008-4bcf-9076-75155bcb4f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:56.011744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c970-b008-4bcf-9076-75155bcb4f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:56.012938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c970-b008-4bcf-9076-75155bcb4f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:56.015511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c970-b008-4bcf-9076-75155bcb4f24 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:56.109988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 856/1727] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:57:55 2021] POST /identity/v3/projects => generated 403 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:56.112433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044f58b-3206-4dbd-9c0b-87b9bedacda2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:56.137762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044f58b-3206-4dbd-9c0b-87b9bedacda2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:56.311097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bb92a-e6a0-4b9e-965f-fa33ce11e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:56.311995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bb92a-e6a0-4b9e-965f-fa33ce11e77c admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:56.312363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bb92a-e6a0-4b9e-965f-fa33ce11e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:56.312718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bb92a-e6a0-4b9e-965f-fa33ce11e77c admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:56.313625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bb92a-e6a0-4b9e-965f-fa33ce11e77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:56.319139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bb92a-e6a0-4b9e-965f-fa33ce11e77c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:56.387380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 872/1728] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:57:56 2021] POST /identity/v3/users => generated 308 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:57:56.390654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c970-b008-4bcf-9076-75155bcb4f24 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:56.412308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c970-b008-4bcf-9076-75155bcb4f24 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:56.424620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5045bc2-dabc-4881-b605-bfc57f87c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:56.426242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045bc2-dabc-4881-b605-bfc57f87c57d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:56.427006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045bc2-dabc-4881-b605-bfc57f87c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:56.427712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045bc2-dabc-4881-b605-bfc57f87c57d admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:56.429221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5045bc2-dabc-4881-b605-bfc57f87c57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:56.433256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5045bc2-dabc-4881-b605-bfc57f87c57d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:56.464481 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 857/1729] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:56 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:56.469897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bb92a-e6a0-4b9e-965f-fa33ce11e77c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:56.484202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bb92a-e6a0-4b9e-965f-fa33ce11e77c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:56.496811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a128-f71a-4758-a97c-74afde42f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:56.497993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a128-f71a-4758-a97c-74afde42f099 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:56.498704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a128-f71a-4758-a97c-74afde42f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:56.499250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a128-f71a-4758-a97c-74afde42f099 admin admin] PATH_INFO: `/v3/projects/2eff3aa1347a4c489b9c9b4d7dd85571/users/927fb4ccd7404d2d845a5e442bc7e375/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:56.562422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5a128-f71a-4758-a97c-74afde42f099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eff3aa1347a4c489b9c9b4d7dd85571, user_id=927fb4ccd7404d2d845a5e442bc7e375, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:56.570619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5a128-f71a-4758-a97c-74afde42f099 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:56.618920 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 873/1730] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:56 2021] PUT /identity/v3/projects/2eff3aa1347a4c489b9c9b4d7dd85571/users/927fb4ccd7404d2d845a5e442bc7e375/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:56.620419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5045bc2-dabc-4881-b605-bfc57f87c57d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:56.639739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5045bc2-dabc-4881-b605-bfc57f87c57d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:56.944148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:56.944518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:56.944861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:56.945289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:56.946115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:56.948278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:56.973509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 858/1731] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:57:56 2021] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:57:56.975248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a128-f71a-4758-a97c-74afde42f099 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:56.989141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a128-f71a-4758-a97c-74afde42f099 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:56.998371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec82bb0-8e7f-430a-aa70-135fc11d8b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:57.006822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec82bb0-8e7f-430a-aa70-135fc11d8b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:57.009066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec82bb0-8e7f-430a-aa70-135fc11d8b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:57.009548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec82bb0-8e7f-430a-aa70-135fc11d8b67 admin admin] PATH_INFO: `/v3/projects/2eff3aa1347a4c489b9c9b4d7dd85571/users/927fb4ccd7404d2d845a5e442bc7e375/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:57.013743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec82bb0-8e7f-430a-aa70-135fc11d8b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eff3aa1347a4c489b9c9b4d7dd85571, user_id=927fb4ccd7404d2d845a5e442bc7e375, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:57.016938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec82bb0-8e7f-430a-aa70-135fc11d8b67 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:57.030456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 874/1732] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:57:56 2021] PUT /identity/v3/projects/2eff3aa1347a4c489b9c9b4d7dd85571/users/927fb4ccd7404d2d845a5e442bc7e375/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:58.146985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:58.148909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:58.163693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd20928-4251-4341-ad60-1f478e7102f1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:58.307477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:58.308720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:58.309165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:58.309613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] PATH_INFO: `/v3/users/cfb07c50e34a4608a5d8a79868b5cb6a` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:58.311930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb07c50e34a4608a5d8a79868b5cb6a)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:58.315228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:58.389491 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb07c50e34a4608a5d8a79868b5cb6a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:58.400352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb07c50e34a4608a5d8a79868b5cb6a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:58.401566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb07c50e34a4608a5d8a79868b5cb6a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:58.402200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb07c50e34a4608a5d8a79868b5cb6a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:58.413295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb07c50e34a4608a5d8a79868b5cb6a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:58.434536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 859/1733] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:57:58 2021] DELETE /identity/v3/users/cfb07c50e34a4608a5d8a79868b5cb6a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:58.439249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6df3-7fe8-4b9b-896d-84b13f2d26e9 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:58.440163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6df3-7fe8-4b9b-896d-84b13f2d26e9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:58.440668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6df3-7fe8-4b9b-896d-84b13f2d26e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:58.490446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-90fc6df3-7fe8-4b9b-896d-84b13f2d26e9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:58.492268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-90fc6df3-7fe8-4b9b-896d-84b13f2d26e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:58.668103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 875/1734] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:57:58.679596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:58.683008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:58.784157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e72ce-f208-4c00-a739-9ff982e9dba2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:58.801067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:58.802069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:58.802612 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:58.803154 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:58.818854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:58.820673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:58.833257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 860/1735] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:57:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:57:59.243062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab046b2-78f5-43e3-8ad2-71577f70f547 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:59.243427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab046b2-78f5-43e3-8ad2-71577f70f547 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:59.243834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab046b2-78f5-43e3-8ad2-71577f70f547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:59.322921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-fab046b2-78f5-43e3-8ad2-71577f70f547 None None] MFA Rules not processed for user `927fb4ccd7404d2d845a5e442bc7e375`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:57:59.324452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fab046b2-78f5-43e3-8ad2-71577f70f547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:59.380013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:59.382004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:57:59.395466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8144f-ffc9-43f5-8ac3-11c841d1843e service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:59.400504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:59.402016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:59.402567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:59.403087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] PATH_INFO: `/v3/projects/088f36855be84595b9efb29342649229` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:59.404835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=088f36855be84595b9efb29342649229)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:59.407182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:59.447966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 876/1736] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:57:59 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:57:59.513200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088f36855be84595b9efb29342649229', 'request_id': 'req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.522153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088f36855be84595b9efb29342649229', 'request_id': 'req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.535609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088f36855be84595b9efb29342649229', 'request_id': 'req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.569519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] The token cache is being invalidate because project 088f36855be84595b9efb29342649229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:57:59.570033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.571675 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.574949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 861/1737] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:57:59 2021] DELETE /identity/v3/projects/088f36855be84595b9efb29342649229 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:57:59.580696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab046b2-78f5-43e3-8ad2-71577f70f547 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:57:59.598161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab046b2-78f5-43e3-8ad2-71577f70f547 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:57:59.721673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:57:59.722783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:57:59.723549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:57:59.723549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] PATH_INFO: `/v3/users/6fbf2fbb0b084fa78a8542b72254f827` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:57:59.724678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbf2fbb0b084fa78a8542b72254f827)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:57:59.727244 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:57:59.792780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbf2fbb0b084fa78a8542b72254f827'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.804383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbf2fbb0b084fa78a8542b72254f827'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.806426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbf2fbb0b084fa78a8542b72254f827'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.807399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbf2fbb0b084fa78a8542b72254f827'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.825737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6be4c2a-45fe-421c-a9bb-78a44c5aab39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbf2fbb0b084fa78a8542b72254f827'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:57:59.845986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 877/1738] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:57:59 2021] DELETE /identity/v3/users/6fbf2fbb0b084fa78a8542b72254f827 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:00.315683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:00.317533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:00.343755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7028c-4dc1-4786-92e3-4cb84a4e7a40 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:00.446760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:00.448222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:00.448725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:00.449212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] PATH_INFO: `/v3/projects/31164bf256a24f4bbd369994a520419d` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:00.451349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=31164bf256a24f4bbd369994a520419d)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:00.455187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:00.556492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31164bf256a24f4bbd369994a520419d', 'request_id': 'req-d927ac09-9eef-4249-bce0-1158d64d43bd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:00.566929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31164bf256a24f4bbd369994a520419d', 'request_id': 'req-d927ac09-9eef-4249-bce0-1158d64d43bd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:00.581255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31164bf256a24f4bbd369994a520419d', 'request_id': 'req-d927ac09-9eef-4249-bce0-1158d64d43bd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:00.615915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] The token cache is being invalidate because project 31164bf256a24f4bbd369994a520419d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:00.616599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:00.617672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d927ac09-9eef-4249-bce0-1158d64d43bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:00.623170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 862/1739] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:00 2021] DELETE /identity/v3/projects/31164bf256a24f4bbd369994a520419d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:00.630672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ef99-b9a7-4bce-ba8a-495f3f4d9bfc None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:00.631456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ef99-b9a7-4bce-ba8a-495f3f4d9bfc None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:00.631618 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ef99-b9a7-4bce-ba8a-495f3f4d9bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:00.657400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a704ef99-b9a7-4bce-ba8a-495f3f4d9bfc None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:00.658644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a704ef99-b9a7-4bce-ba8a-495f3f4d9bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:00.765336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 878/1740] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:00.774561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dd199-fb31-4260-b7f4-67f7fbf91891 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:00.774909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dd199-fb31-4260-b7f4-67f7fbf91891 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:00.775335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dd199-fb31-4260-b7f4-67f7fbf91891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:00.802425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-9b1dd199-fb31-4260-b7f4-67f7fbf91891 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:00.803819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9b1dd199-fb31-4260-b7f4-67f7fbf91891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:00.812230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 863/1741] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:00.819107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704ef99-b9a7-4bce-ba8a-495f3f4d9bfc None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:00.831020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704ef99-b9a7-4bce-ba8a-495f3f4d9bfc None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:00.837799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:00.839226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:00.839664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:00.840110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:00.841024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:00.841534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:00.843703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:00.862477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 879/1742] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:58:00.868725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dd199-fb31-4260-b7f4-67f7fbf91891 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:00.881498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dd199-fb31-4260-b7f4-67f7fbf91891 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:00.889560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9d2ac-af3d-4c03-b2ae-0526feb9c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:00.890519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9d2ac-af3d-4c03-b2ae-0526feb9c8fb admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:00.890994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9d2ac-af3d-4c03-b2ae-0526feb9c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:00.891568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9d2ac-af3d-4c03-b2ae-0526feb9c8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:00.892526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9d2ac-af3d-4c03-b2ae-0526feb9c8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:00.896580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9d2ac-af3d-4c03-b2ae-0526feb9c8fb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:00.943108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 864/1743] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:00 2021] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:00.948820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:00.959873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09e6f3-675f-4f77-a0cd-1f3912eb6d01 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:01.039525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dca8f2-3194-4c3d-87b8-d533078cea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:01.039917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dca8f2-3194-4c3d-87b8-d533078cea37 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:01.040190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dca8f2-3194-4c3d-87b8-d533078cea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:01.040473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dca8f2-3194-4c3d-87b8-d533078cea37 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:01.041129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dca8f2-3194-4c3d-87b8-d533078cea37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:01.043219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dca8f2-3194-4c3d-87b8-d533078cea37 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:01.074203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 880/1744] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:00 2021] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:01.081821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9d2ac-af3d-4c03-b2ae-0526feb9c8fb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:01.101656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9d2ac-af3d-4c03-b2ae-0526feb9c8fb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:01.110160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a0126-8bb6-45d2-969f-9e3492762a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:01.111371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a0126-8bb6-45d2-969f-9e3492762a59 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:01.111885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a0126-8bb6-45d2-969f-9e3492762a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:01.112462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a0126-8bb6-45d2-969f-9e3492762a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:01.113723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a0126-8bb6-45d2-969f-9e3492762a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:01.117354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a0126-8bb6-45d2-969f-9e3492762a59 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:01.146954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 865/1745] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:01 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:01.149592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dca8f2-3194-4c3d-87b8-d533078cea37 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:01.176228 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dca8f2-3194-4c3d-87b8-d533078cea37 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:01.189397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9d9a0-6ffe-43d1-9e2b-25a0e062d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:01.191055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9d9a0-6ffe-43d1-9e2b-25a0e062d14c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:01.191904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9d9a0-6ffe-43d1-9e2b-25a0e062d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:01.192684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9d9a0-6ffe-43d1-9e2b-25a0e062d14c admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:01.195176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9d9a0-6ffe-43d1-9e2b-25a0e062d14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:01.198460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9d9a0-6ffe-43d1-9e2b-25a0e062d14c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:01.225054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 881/1746] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:01 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:01.232020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a0126-8bb6-45d2-969f-9e3492762a59 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:01.251404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a0126-8bb6-45d2-969f-9e3492762a59 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:01.259849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca64f2-bd1f-49a5-8c36-d752d1e8d276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:01.261410 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca64f2-bd1f-49a5-8c36-d752d1e8d276 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:01.261914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca64f2-bd1f-49a5-8c36-d752d1e8d276 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:01.262445 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca64f2-bd1f-49a5-8c36-d752d1e8d276 admin admin] PATH_INFO: `/v3/projects/b5959a23f6a24fb6a824a7618dd315b3/users/0a8a7aee924b4732a06fb20fd7ece8dc/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:01.305617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca64f2-bd1f-49a5-8c36-d752d1e8d276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5959a23f6a24fb6a824a7618dd315b3, user_id=0a8a7aee924b4732a06fb20fd7ece8dc, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:01.314059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca64f2-bd1f-49a5-8c36-d752d1e8d276 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:01.358447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 866/1747] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:01 2021] PUT /identity/v3/projects/b5959a23f6a24fb6a824a7618dd315b3/users/0a8a7aee924b4732a06fb20fd7ece8dc/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:01.367816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed033-3116-4128-9b2a-34076a9aaa2c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:01.367816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed033-3116-4128-9b2a-34076a9aaa2c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:01.368341 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed033-3116-4128-9b2a-34076a9aaa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:01.479468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2a1ed033-3116-4128-9b2a-34076a9aaa2c None None] MFA Rules not processed for user `0a8a7aee924b4732a06fb20fd7ece8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:01.481563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2a1ed033-3116-4128-9b2a-34076a9aaa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:01.728347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 882/1748] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:01 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:01.737386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca64f2-bd1f-49a5-8c36-d752d1e8d276 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:01.983063 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca64f2-bd1f-49a5-8c36-d752d1e8d276 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:02.009806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6610dc-10bd-4b94-a68f-a67cdde1686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:02.013696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6610dc-10bd-4b94-a68f-a67cdde1686c admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:02.014341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6610dc-10bd-4b94-a68f-a67cdde1686c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:02.016059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6610dc-10bd-4b94-a68f-a67cdde1686c admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:02.017340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6610dc-10bd-4b94-a68f-a67cdde1686c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:02.026565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6610dc-10bd-4b94-a68f-a67cdde1686c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:02.130577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ed033-3116-4128-9b2a-34076a9aaa2c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:02.134231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 867/1749] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:01 2021] POST /identity/v3/projects => generated 383 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:02.181473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ed033-3116-4128-9b2a-34076a9aaa2c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:02.416043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf11787-9279-4b43-abbe-ac6679fdd504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:02.417120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf11787-9279-4b43-abbe-ac6679fdd504 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:02.417552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf11787-9279-4b43-abbe-ac6679fdd504 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:02.417948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf11787-9279-4b43-abbe-ac6679fdd504 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:02.419176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf11787-9279-4b43-abbe-ac6679fdd504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:02.421762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf11787-9279-4b43-abbe-ac6679fdd504 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:02.497862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 883/1750] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:02 2021] POST /identity/v3/users => generated 292 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:02.504488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6610dc-10bd-4b94-a68f-a67cdde1686c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:02.550459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6610dc-10bd-4b94-a68f-a67cdde1686c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:02.563254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61b2f4-d5d5-45d4-a065-db7a30274271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:02.564289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b2f4-d5d5-45d4-a065-db7a30274271 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:02.564793 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b2f4-d5d5-45d4-a065-db7a30274271 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:02.565302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b2f4-d5d5-45d4-a065-db7a30274271 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:02.566658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61b2f4-d5d5-45d4-a065-db7a30274271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:02.574977 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61b2f4-d5d5-45d4-a065-db7a30274271 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:02.617293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf11787-9279-4b43-abbe-ac6679fdd504 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:02.624103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 868/1751] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:58:02.644293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf11787-9279-4b43-abbe-ac6679fdd504 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:02.672359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c4920-00ca-4b07-95a3-067576500989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:02.676694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4920-00ca-4b07-95a3-067576500989 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:02.677717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4920-00ca-4b07-95a3-067576500989 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:02.678504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4920-00ca-4b07-95a3-067576500989 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:02.680828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c4920-00ca-4b07-95a3-067576500989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:02.689099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c4920-00ca-4b07-95a3-067576500989 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:02.746304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 884/1752] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:58:02.752653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61b2f4-d5d5-45d4-a065-db7a30274271 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:02.772733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61b2f4-d5d5-45d4-a065-db7a30274271 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:02.787663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed20ee9-f4f1-48f4-a34d-c5a5fa801d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:02.789917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed20ee9-f4f1-48f4-a34d-c5a5fa801d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:02.790779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed20ee9-f4f1-48f4-a34d-c5a5fa801d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:02.792195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed20ee9-f4f1-48f4-a34d-c5a5fa801d12 admin admin] PATH_INFO: `/v3/projects/baf9d62c9a9c4d34ac07caec1ee20a2e/users/b99f4b090dfc42bd90d6b606d14a7870/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:02.848378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed20ee9-f4f1-48f4-a34d-c5a5fa801d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf9d62c9a9c4d34ac07caec1ee20a2e, user_id=b99f4b090dfc42bd90d6b606d14a7870, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:02.856510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed20ee9-f4f1-48f4-a34d-c5a5fa801d12 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:02.892309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 869/1753] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:02 2021] PUT /identity/v3/projects/baf9d62c9a9c4d34ac07caec1ee20a2e/users/b99f4b090dfc42bd90d6b606d14a7870/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:02.912985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731eeb6-eea7-4e61-af68-499ecad3c6bb None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:02.913485 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731eeb6-eea7-4e61-af68-499ecad3c6bb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:02.914075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731eeb6-eea7-4e61-af68-499ecad3c6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:02.998711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2731eeb6-eea7-4e61-af68-499ecad3c6bb None None] MFA Rules not processed for user `b99f4b090dfc42bd90d6b606d14a7870`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:03.001145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2731eeb6-eea7-4e61-af68-499ecad3c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:03.236979 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 885/1754] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:02 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:03.244364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed20ee9-f4f1-48f4-a34d-c5a5fa801d12 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:03.452416 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed20ee9-f4f1-48f4-a34d-c5a5fa801d12 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:03.464126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23576112-47e7-4d8d-aaea-573e1622b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:03.464830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576112-47e7-4d8d-aaea-573e1622b30b admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:03.465121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576112-47e7-4d8d-aaea-573e1622b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:03.465400 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576112-47e7-4d8d-aaea-573e1622b30b admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:03.466146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23576112-47e7-4d8d-aaea-573e1622b30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:03.468344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23576112-47e7-4d8d-aaea-573e1622b30b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:03.545917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 870/1755] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:03 2021] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:03.547757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731eeb6-eea7-4e61-af68-499ecad3c6bb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:03.573330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731eeb6-eea7-4e61-af68-499ecad3c6bb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:03.828944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21b888-39ab-4804-ab26-52e2813be214 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:03.829434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21b888-39ab-4804-ab26-52e2813be214 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:03.829602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21b888-39ab-4804-ab26-52e2813be214 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:03.831783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 871/1756] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 14:58:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 14:58:03.892722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee28dc-e0cb-48ef-bb67-2341089b67e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:03.896393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee28dc-e0cb-48ef-bb67-2341089b67e0 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:03.896789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee28dc-e0cb-48ef-bb67-2341089b67e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:03.897286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee28dc-e0cb-48ef-bb67-2341089b67e0 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:03.898580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee28dc-e0cb-48ef-bb67-2341089b67e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:03.907504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee28dc-e0cb-48ef-bb67-2341089b67e0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:03.980793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 886/1757] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:03 2021] POST /identity/v3/users => generated 300 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:03.986690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21b888-39ab-4804-ab26-52e2813be214 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:04.028114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21b888-39ab-4804-ab26-52e2813be214 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:04.038291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418448f-c4f3-4f1f-a44d-1645f3b24c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:04.039202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418448f-c4f3-4f1f-a44d-1645f3b24c7a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:04.039716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418448f-c4f3-4f1f-a44d-1645f3b24c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:04.040141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418448f-c4f3-4f1f-a44d-1645f3b24c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:04.041107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418448f-c4f3-4f1f-a44d-1645f3b24c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:04.048145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418448f-c4f3-4f1f-a44d-1645f3b24c7a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:04.080254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 872/1758] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:03 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:04.080416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee28dc-e0cb-48ef-bb67-2341089b67e0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:04.099442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee28dc-e0cb-48ef-bb67-2341089b67e0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:04.113835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27eb19-2cfa-4bc4-8699-04e90b5df2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:04.114836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27eb19-2cfa-4bc4-8699-04e90b5df2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:04.115194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27eb19-2cfa-4bc4-8699-04e90b5df2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:04.115542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27eb19-2cfa-4bc4-8699-04e90b5df2b4 admin admin] PATH_INFO: `/v3/projects/f6e06c1c827b407eb2e4bf65cd722d20/users/8439f03861614f5ab3bd8402d05982cb/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:04.158361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10230-5da4-4422-b7b1-0bba4605eea1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:04.158955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10230-5da4-4422-b7b1-0bba4605eea1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:04.159375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10230-5da4-4422-b7b1-0bba4605eea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:04.164039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27eb19-2cfa-4bc4-8699-04e90b5df2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e06c1c827b407eb2e4bf65cd722d20, user_id=8439f03861614f5ab3bd8402d05982cb, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:04.169457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27eb19-2cfa-4bc4-8699-04e90b5df2b4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:04.206342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 887/1759] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:04 2021] PUT /identity/v3/projects/f6e06c1c827b407eb2e4bf65cd722d20/users/8439f03861614f5ab3bd8402d05982cb/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:04.211964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27eb19-2cfa-4bc4-8699-04e90b5df2b4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:04.231472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-aff10230-5da4-4422-b7b1-0bba4605eea1 None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:04.232976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-aff10230-5da4-4422-b7b1-0bba4605eea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:04.410579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27eb19-2cfa-4bc4-8699-04e90b5df2b4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:04.424169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 873/1760] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 14:58:04 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:04.443619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520fbfe-8ce8-4b48-9862-5cb3c70977ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:04.444502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520fbfe-8ce8-4b48-9862-5cb3c70977ac admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:04.444622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520fbfe-8ce8-4b48-9862-5cb3c70977ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:04.444811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520fbfe-8ce8-4b48-9862-5cb3c70977ac admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:04.446139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520fbfe-8ce8-4b48-9862-5cb3c70977ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:04.448413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520fbfe-8ce8-4b48-9862-5cb3c70977ac admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:04.490103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 888/1761] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:04 2021] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:04.496884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff10230-5da4-4422-b7b1-0bba4605eea1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:04.512207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff10230-5da4-4422-b7b1-0bba4605eea1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:04.536563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:04.537434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:04.537712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:04.538156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] PATH_INFO: `/v3/projects/f6e06c1c827b407eb2e4bf65cd722d20/users/8439f03861614f5ab3bd8402d05982cb/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:04.543062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e06c1c827b407eb2e4bf65cd722d20, user_id=8439f03861614f5ab3bd8402d05982cb, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:04.546012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:04.573279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 874/1762] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:04 2021] PUT /identity/v3/projects/f6e06c1c827b407eb2e4bf65cd722d20/users/8439f03861614f5ab3bd8402d05982cb/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:04.592121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d032ee-38c3-46f2-a6d1-b880bc296c43 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:04.592495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d032ee-38c3-46f2-a6d1-b880bc296c43 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:04.592771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d032ee-38c3-46f2-a6d1-b880bc296c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:04.741548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-79d032ee-38c3-46f2-a6d1-b880bc296c43 None None] MFA Rules not processed for user `8439f03861614f5ab3bd8402d05982cb`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:04.747565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-79d032ee-38c3-46f2-a6d1-b880bc296c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:04.974966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 889/1763] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:04 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:04.998576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:05.001588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:05.177169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d244e4-bfb1-4c91-8da4-15666b969d1a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:05.198082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:05.199064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:05.199579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:05.201258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:05.252212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:05.258895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:05.306332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 875/1764] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:04 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:05.789667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d032ee-38c3-46f2-a6d1-b880bc296c43 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:05.792074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-79d032ee-38c3-46f2-a6d1-b880bc296c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:06.013535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:06.014994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d032ee-38c3-46f2-a6d1-b880bc296c43 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:06.015639 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:06.020103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:06.020922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:06.021212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:06.021565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] PATH_INFO: `/v3/users/a1dded3d7a0e4bbc9b7cddbac2ef6b43` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:06.024356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1dded3d7a0e4bbc9b7cddbac2ef6b43)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:06.028238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:06.111121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc641b9-4690-4d96-b5cb-8dd995e7e2dc service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:06.116349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1dded3d7a0e4bbc9b7cddbac2ef6b43'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.120554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:06.121605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:06.122122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:06.122671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:06.128994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1dded3d7a0e4bbc9b7cddbac2ef6b43'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.129927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1dded3d7a0e4bbc9b7cddbac2ef6b43'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.130755 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1dded3d7a0e4bbc9b7cddbac2ef6b43'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.140023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:06.143328 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:06.153357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1dded3d7a0e4bbc9b7cddbac2ef6b43'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.164866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 876/1765] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:06 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:06.183422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 890/1766] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:05 2021] DELETE /identity/v3/users/a1dded3d7a0e4bbc9b7cddbac2ef6b43 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:06.269644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:06.271092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:06.286606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48f8f3-0f52-4cc8-bac5-4b4dd148c36a service nova] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:06.429281 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:06.430915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:06.432806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:06.433629 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:06.437941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:06.542862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:06.545169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:06.594913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:06.597827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:06.618358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 877/1767] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:06 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:06.670650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc7a56-d700-4fce-85bd-72ba9dfa673e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:06.679920 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:06.681096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:06.682293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:06.682945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] PATH_INFO: `/v3/projects/78515254aa714366b94bbf8fb61b80b4` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:06.684585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78515254aa714366b94bbf8fb61b80b4)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:06.686887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:06.785162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78515254aa714366b94bbf8fb61b80b4', 'request_id': 'req-46c8a19b-3b71-4921-b545-d67d1dacd543'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.793327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78515254aa714366b94bbf8fb61b80b4', 'request_id': 'req-46c8a19b-3b71-4921-b545-d67d1dacd543'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.804108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78515254aa714366b94bbf8fb61b80b4', 'request_id': 'req-46c8a19b-3b71-4921-b545-d67d1dacd543'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.826473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] The token cache is being invalidate because project 78515254aa714366b94bbf8fb61b80b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:06.827179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.828291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:06.830708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 891/1768] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:06 2021] DELETE /identity/v3/projects/78515254aa714366b94bbf8fb61b80b4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:06.835314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:06.848919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143eafb-7625-46e9-938b-96a97a35c42c service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:06.954474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:06.955815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:06.956299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:06.956739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] PATH_INFO: `/v3/users/927fb4ccd7404d2d845a5e442bc7e375` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:06.958679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=927fb4ccd7404d2d845a5e442bc7e375)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:06.962151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:07.039067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927fb4ccd7404d2d845a5e442bc7e375'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.054956 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927fb4ccd7404d2d845a5e442bc7e375'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.056092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927fb4ccd7404d2d845a5e442bc7e375'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.057212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927fb4ccd7404d2d845a5e442bc7e375'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.071663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f32bb9a5-7bcc-4753-b0dc-6d64ee467977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927fb4ccd7404d2d845a5e442bc7e375'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.099084 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 878/1769] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:06 2021] DELETE /identity/v3/users/927fb4ccd7404d2d845a5e442bc7e375 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:07.630385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:07.632017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:07.647130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8a19b-3b71-4921-b545-d67d1dacd543 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:07.729277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:07.730100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:07.730482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:07.730763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] PATH_INFO: `/v3/projects/2eff3aa1347a4c489b9c9b4d7dd85571` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:07.732121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eff3aa1347a4c489b9c9b4d7dd85571)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:07.735078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:07.796360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eff3aa1347a4c489b9c9b4d7dd85571', 'request_id': 'req-27d3a28e-47f3-4494-8353-7a6b1954b64d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.803926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eff3aa1347a4c489b9c9b4d7dd85571', 'request_id': 'req-27d3a28e-47f3-4494-8353-7a6b1954b64d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.820825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eff3aa1347a4c489b9c9b4d7dd85571', 'request_id': 'req-27d3a28e-47f3-4494-8353-7a6b1954b64d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.843469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] The token cache is being invalidate because project 2eff3aa1347a4c489b9c9b4d7dd85571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:07.844000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.844919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-27d3a28e-47f3-4494-8353-7a6b1954b64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:07.846689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 892/1770] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:07 2021] DELETE /identity/v3/projects/2eff3aa1347a4c489b9c9b4d7dd85571 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:07.855881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9e2a-589e-47d9-8ed1-d3a57d0c50a2 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:07.856355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9e2a-589e-47d9-8ed1-d3a57d0c50a2 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:07.856807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9e2a-589e-47d9-8ed1-d3a57d0c50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:07.930189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c4ff9e2a-589e-47d9-8ed1-d3a57d0c50a2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:07.932244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c4ff9e2a-589e-47d9-8ed1-d3a57d0c50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:08.110099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 879/1771] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:08.119812 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8437-acae-48df-b43c-096f5c1cbb89 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:08.120216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8437-acae-48df-b43c-096f5c1cbb89 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:08.120457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8437-acae-48df-b43c-096f5c1cbb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:08.171905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e71e8437-acae-48df-b43c-096f5c1cbb89 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:08.174581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e71e8437-acae-48df-b43c-096f5c1cbb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:08.192725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 893/1772] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:08.205692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff9e2a-589e-47d9-8ed1-d3a57d0c50a2 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:08.223856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff9e2a-589e-47d9-8ed1-d3a57d0c50a2 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:08.234661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:08.237556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:08.239329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:08.239919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:08.241610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:08.242146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:08.261189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:08.300859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e8437-acae-48df-b43c-096f5c1cbb89 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:08.302109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 880/1773] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:08.345154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e8437-acae-48df-b43c-096f5c1cbb89 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:08.376582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1c97b-9efe-4236-91ae-56cf60403ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:08.377562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c97b-9efe-4236-91ae-56cf60403ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:08.378024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c97b-9efe-4236-91ae-56cf60403ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:08.378509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c97b-9efe-4236-91ae-56cf60403ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:08.379649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1c97b-9efe-4236-91ae-56cf60403ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:08.388209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1c97b-9efe-4236-91ae-56cf60403ac8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:08.445535 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 894/1774] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:08 2021] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:08.449864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:08.467152 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ef99-cb66-4e7a-ab87-9afb3a7d8870 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:08.696757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979d95-c29e-462f-8dee-f2c12fedf935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:08.698319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979d95-c29e-462f-8dee-f2c12fedf935 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:08.698995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979d95-c29e-462f-8dee-f2c12fedf935 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:08.699573 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979d95-c29e-462f-8dee-f2c12fedf935 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:08.701571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82979d95-c29e-462f-8dee-f2c12fedf935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:08.707700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82979d95-c29e-462f-8dee-f2c12fedf935 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:08.763684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 881/1775] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:08 2021] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:08.771064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1c97b-9efe-4236-91ae-56cf60403ac8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:08.860187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1c97b-9efe-4236-91ae-56cf60403ac8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:08.901651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fce99a-ea49-49c7-a122-1a86d1af412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:08.907442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fce99a-ea49-49c7-a122-1a86d1af412d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:08.909830 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fce99a-ea49-49c7-a122-1a86d1af412d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:08.912059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fce99a-ea49-49c7-a122-1a86d1af412d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:08.918025 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fce99a-ea49-49c7-a122-1a86d1af412d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:08.934642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fce99a-ea49-49c7-a122-1a86d1af412d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:08.988864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 895/1776] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:08 2021] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:08.994839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979d95-c29e-462f-8dee-f2c12fedf935 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:09.044725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979d95-c29e-462f-8dee-f2c12fedf935 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:09.054954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f1972-76c5-49ff-81d4-59308a523329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:09.057132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f1972-76c5-49ff-81d4-59308a523329 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:09.058170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f1972-76c5-49ff-81d4-59308a523329 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:09.058920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f1972-76c5-49ff-81d4-59308a523329 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:09.060524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f1972-76c5-49ff-81d4-59308a523329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:09.064769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f1972-76c5-49ff-81d4-59308a523329 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:09.093712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 882/1777] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:08 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:09.100550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fce99a-ea49-49c7-a122-1a86d1af412d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:09.135566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fce99a-ea49-49c7-a122-1a86d1af412d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:09.152671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6be9af-6c56-4808-ad99-2935299a7c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:09.155087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6be9af-6c56-4808-ad99-2935299a7c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:09.156067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6be9af-6c56-4808-ad99-2935299a7c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:09.157046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6be9af-6c56-4808-ad99-2935299a7c35 admin admin] PATH_INFO: `/v3/projects/c6d5ba1daecf4cf88656ea8ed188aa03/users/1c7beef0f5024c62974aa32843f99c55/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:09.239074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6be9af-6c56-4808-ad99-2935299a7c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5ba1daecf4cf88656ea8ed188aa03, user_id=1c7beef0f5024c62974aa32843f99c55, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:09.244691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6be9af-6c56-4808-ad99-2935299a7c35 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:09.292678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 896/1778] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:09 2021] PUT /identity/v3/projects/c6d5ba1daecf4cf88656ea8ed188aa03/users/1c7beef0f5024c62974aa32843f99c55/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:09.303827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08430164-762f-4536-8e92-dc8074bbde4f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:09.304943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08430164-762f-4536-8e92-dc8074bbde4f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:09.304943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08430164-762f-4536-8e92-dc8074bbde4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:09.376025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-08430164-762f-4536-8e92-dc8074bbde4f None None] MFA Rules not processed for user `1c7beef0f5024c62974aa32843f99c55`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:09.377228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-08430164-762f-4536-8e92-dc8074bbde4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:09.503511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 883/1779] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:09 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:09.508509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6be9af-6c56-4808-ad99-2935299a7c35 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:09.694138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6be9af-6c56-4808-ad99-2935299a7c35 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:09.716076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943d043-79ee-4c7f-a03d-dfa5d55360fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:09.718803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943d043-79ee-4c7f-a03d-dfa5d55360fc admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:09.719501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943d043-79ee-4c7f-a03d-dfa5d55360fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:09.720184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943d043-79ee-4c7f-a03d-dfa5d55360fc admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:09.721963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943d043-79ee-4c7f-a03d-dfa5d55360fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:09.723990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943d043-79ee-4c7f-a03d-dfa5d55360fc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:09.806562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 897/1780] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:09 2021] POST /identity/v3/projects => generated 387 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:09.812623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08430164-762f-4536-8e92-dc8074bbde4f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:09.858260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08430164-762f-4536-8e92-dc8074bbde4f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:09.988965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b66348-b0d8-47c8-b461-c4e1ae47b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:09.990078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b66348-b0d8-47c8-b461-c4e1ae47b3ad admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:09.990732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b66348-b0d8-47c8-b461-c4e1ae47b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:09.991241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b66348-b0d8-47c8-b461-c4e1ae47b3ad admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:09.992206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b66348-b0d8-47c8-b461-c4e1ae47b3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:09.995261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b66348-b0d8-47c8-b461-c4e1ae47b3ad admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:10.059298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 884/1781] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:09 2021] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:10.060683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943d043-79ee-4c7f-a03d-dfa5d55360fc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:10.071855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943d043-79ee-4c7f-a03d-dfa5d55360fc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:10.077670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3f84-3913-4d22-bf53-073fee9ac2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:10.078331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3f84-3913-4d22-bf53-073fee9ac2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:10.078699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3f84-3913-4d22-bf53-073fee9ac2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:10.079009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3f84-3913-4d22-bf53-073fee9ac2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:10.079810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b3f84-3913-4d22-bf53-073fee9ac2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:10.081866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b3f84-3913-4d22-bf53-073fee9ac2a5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:10.099260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 898/1782] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:10 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:58:10.101144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b66348-b0d8-47c8-b461-c4e1ae47b3ad admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:10.124850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b66348-b0d8-47c8-b461-c4e1ae47b3ad admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:10.133708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1350e79-9c99-43e6-8eac-b48c17d07aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:10.135214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350e79-9c99-43e6-8eac-b48c17d07aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:10.135814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350e79-9c99-43e6-8eac-b48c17d07aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:10.136117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350e79-9c99-43e6-8eac-b48c17d07aa3 admin admin] PATH_INFO: `/v3/projects/da24ce4b061b433fbdd0c5a8f0f20fcf/users/0913cbf3853e4e339cc370603d31aabe/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:10.172356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1350e79-9c99-43e6-8eac-b48c17d07aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da24ce4b061b433fbdd0c5a8f0f20fcf, user_id=0913cbf3853e4e339cc370603d31aabe, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:10.180226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1350e79-9c99-43e6-8eac-b48c17d07aa3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:10.202490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 885/1783] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:10 2021] PUT /identity/v3/projects/da24ce4b061b433fbdd0c5a8f0f20fcf/users/0913cbf3853e4e339cc370603d31aabe/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:10.204435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3f84-3913-4d22-bf53-073fee9ac2a5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:10.231098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3f84-3913-4d22-bf53-073fee9ac2a5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:10.446821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19646f6-1279-4770-97d0-d5a79bf8013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:10.448455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19646f6-1279-4770-97d0-d5a79bf8013d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:10.448914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19646f6-1279-4770-97d0-d5a79bf8013d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:10.449395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19646f6-1279-4770-97d0-d5a79bf8013d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:10.450645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19646f6-1279-4770-97d0-d5a79bf8013d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:10.455977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19646f6-1279-4770-97d0-d5a79bf8013d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:10.493119 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 899/1784] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:10 2021] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:10.496362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1350e79-9c99-43e6-8eac-b48c17d07aa3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:10.528420 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1350e79-9c99-43e6-8eac-b48c17d07aa3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:10.538662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:10.540323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:10.541587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:10.541948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] PATH_INFO: `/v3/projects/da24ce4b061b433fbdd0c5a8f0f20fcf/users/0913cbf3853e4e339cc370603d31aabe/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:10.546323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da24ce4b061b433fbdd0c5a8f0f20fcf, user_id=0913cbf3853e4e339cc370603d31aabe, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:10.552694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:10.581144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 886/1785] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:10 2021] PUT /identity/v3/projects/da24ce4b061b433fbdd0c5a8f0f20fcf/users/0913cbf3853e4e339cc370603d31aabe/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:10.592622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fcdd6-809b-41d2-b317-594e14ffa9e0 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:10.593512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fcdd6-809b-41d2-b317-594e14ffa9e0 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:10.593512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fcdd6-809b-41d2-b317-594e14ffa9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:10.665939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-fa6fcdd6-809b-41d2-b317-594e14ffa9e0 None None] MFA Rules not processed for user `0913cbf3853e4e339cc370603d31aabe`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:10.668161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fa6fcdd6-809b-41d2-b317-594e14ffa9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:10.849334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 900/1786] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:10 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:10.890452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:10.892537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:10.976005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d213056-8620-48da-a5e6-37f169012e3e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:10.989959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea33558-e88e-43ce-9755-628e3a491059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:10.990293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33558-e88e-43ce-9755-628e3a491059 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:10.990513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33558-e88e-43ce-9755-628e3a491059 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:10.990784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33558-e88e-43ce-9755-628e3a491059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:11.010760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea33558-e88e-43ce-9755-628e3a491059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:11.014394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea33558-e88e-43ce-9755-628e3a491059 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:11.050789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 887/1787] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:10 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:11.356672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fcdd6-809b-41d2-b317-594e14ffa9e0 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:11.499061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fcdd6-809b-41d2-b317-594e14ffa9e0 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:11.509173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:11.511939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:11.512766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:11.513293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] PATH_INFO: `/v3/users/1c7beef0f5024c62974aa32843f99c55` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:11.515491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7beef0f5024c62974aa32843f99c55)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:11.519414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:11.719033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7beef0f5024c62974aa32843f99c55'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:11.738090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7beef0f5024c62974aa32843f99c55'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:11.738854 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7beef0f5024c62974aa32843f99c55'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:11.740129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7beef0f5024c62974aa32843f99c55'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:11.769121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7beef0f5024c62974aa32843f99c55'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:11.818826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedd496-b017-4957-84fb-76893442fcc5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:11.819342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedd496-b017-4957-84fb-76893442fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:11.819590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedd496-b017-4957-84fb-76893442fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:11.821621 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 901/1788] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:11 2021] DELETE /identity/v3/users/1c7beef0f5024c62974aa32843f99c55 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:11.870713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6cedd496-b017-4957-84fb-76893442fcc5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:11.871930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6cedd496-b017-4957-84fb-76893442fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:12.046779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 888/1789] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:12.063883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:12.066839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:12.235049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d655-b11a-4db2-a33b-aa226857c025 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:12.245436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08456-a9c7-41ad-be32-d3f2d4c93a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:12.246662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08456-a9c7-41ad-be32-d3f2d4c93a33 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:12.247330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08456-a9c7-41ad-be32-d3f2d4c93a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:12.247938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08456-a9c7-41ad-be32-d3f2d4c93a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:12.274652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08456-a9c7-41ad-be32-d3f2d4c93a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:12.277724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08456-a9c7-41ad-be32-d3f2d4c93a33 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:12.297835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 902/1790] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:13.149374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedd496-b017-4957-84fb-76893442fcc5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:13.151914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6cedd496-b017-4957-84fb-76893442fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:13.171556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedd496-b017-4957-84fb-76893442fcc5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:13.177959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:13.178930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:13.179345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:13.179728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] PATH_INFO: `/v3/projects/c6d5ba1daecf4cf88656ea8ed188aa03` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:13.181111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d5ba1daecf4cf88656ea8ed188aa03)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:13.183814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:13.267702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d5ba1daecf4cf88656ea8ed188aa03', 'request_id': 'req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.282216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d5ba1daecf4cf88656ea8ed188aa03', 'request_id': 'req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.298926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d5ba1daecf4cf88656ea8ed188aa03', 'request_id': 'req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.358274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] The token cache is being invalidate because project c6d5ba1daecf4cf88656ea8ed188aa03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:13.358800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.360969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.365912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 889/1791] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:13 2021] DELETE /identity/v3/projects/c6d5ba1daecf4cf88656ea8ed188aa03 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:13.372692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08456-a9c7-41ad-be32-d3f2d4c93a33 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:13.406550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08456-a9c7-41ad-be32-d3f2d4c93a33 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:13.587704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:13.588538 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:13.588827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:13.589106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] PATH_INFO: `/v3/users/0913cbf3853e4e339cc370603d31aabe` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:13.590724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0913cbf3853e4e339cc370603d31aabe)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:13.594505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:13.682648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0913cbf3853e4e339cc370603d31aabe'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.692731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0913cbf3853e4e339cc370603d31aabe'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.693824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0913cbf3853e4e339cc370603d31aabe'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.694797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0913cbf3853e4e339cc370603d31aabe'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.716440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0913cbf3853e4e339cc370603d31aabe'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:13.739932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 903/1792] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:13 2021] DELETE /identity/v3/users/0913cbf3853e4e339cc370603d31aabe => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:14.424365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:14.426689 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:14.474472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac97f3-a5f7-4b68-a560-44ca584b3e3e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:14.665224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:14.668713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:14.669213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:14.672939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] PATH_INFO: `/v3/projects/da24ce4b061b433fbdd0c5a8f0f20fcf` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:14.677832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da24ce4b061b433fbdd0c5a8f0f20fcf)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:14.691017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:14.695240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:14.696963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:14.875980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da24ce4b061b433fbdd0c5a8f0f20fcf', 'request_id': 'req-71884c5d-6a10-4649-a820-317a29d4e1a9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:14.876306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6da3b-ed68-4366-9da7-af2807954d15 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:14.887229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da24ce4b061b433fbdd0c5a8f0f20fcf', 'request_id': 'req-71884c5d-6a10-4649-a820-317a29d4e1a9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:14.901710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da24ce4b061b433fbdd0c5a8f0f20fcf', 'request_id': 'req-71884c5d-6a10-4649-a820-317a29d4e1a9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:14.946266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] The token cache is being invalidate because project da24ce4b061b433fbdd0c5a8f0f20fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:14.946266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:14.949075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-71884c5d-6a10-4649-a820-317a29d4e1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:14.956431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 890/1793] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:14 2021] DELETE /identity/v3/projects/da24ce4b061b433fbdd0c5a8f0f20fcf => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:14.964327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8dff-f286-494c-bc21-e30692a79d30 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:14.965035 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8dff-f286-494c-bc21-e30692a79d30 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:14.965540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8dff-f286-494c-bc21-e30692a79d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:14.995548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e836ae-5949-47de-987d-12602c5aa3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:14.996475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e836ae-5949-47de-987d-12602c5aa3eb service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:14.997138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e836ae-5949-47de-987d-12602c5aa3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:14.997584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e836ae-5949-47de-987d-12602c5aa3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:14.999924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-39e836ae-5949-47de-987d-12602c5aa3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:15.043939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d41e8dff-f286-494c-bc21-e30692a79d30 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:15.047008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d41e8dff-f286-494c-bc21-e30692a79d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:15.201262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e836ae-5949-47de-987d-12602c5aa3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:15.203275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e836ae-5949-47de-987d-12602c5aa3eb service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:15.234266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 904/1794] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:14 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:15.288304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 891/1795] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:15.295243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff8c5-127c-411f-b75c-0fcc3b8ed016 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:15.295711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff8c5-127c-411f-b75c-0fcc3b8ed016 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:15.296077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff8c5-127c-411f-b75c-0fcc3b8ed016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:15.327892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-661ff8c5-127c-411f-b75c-0fcc3b8ed016 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:15.329489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-661ff8c5-127c-411f-b75c-0fcc3b8ed016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:15.349423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 905/1796] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:15.356457 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e8dff-f286-494c-bc21-e30692a79d30 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:15.379473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e8dff-f286-494c-bc21-e30692a79d30 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:15.391372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:15.392892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:15.394050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:15.395409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:15.397590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:15.398690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:15.404632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:15.443719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 892/1797] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:15.448856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff8c5-127c-411f-b75c-0fcc3b8ed016 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:15.458624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff8c5-127c-411f-b75c-0fcc3b8ed016 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:15.467413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9e71d-a576-4141-89f9-f5c38abefd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:15.468047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9e71d-a576-4141-89f9-f5c38abefd85 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:15.468544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9e71d-a576-4141-89f9-f5c38abefd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:15.468728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9e71d-a576-4141-89f9-f5c38abefd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:15.469302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9e71d-a576-4141-89f9-f5c38abefd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:15.471282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9e71d-a576-4141-89f9-f5c38abefd85 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:15.533770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:15.541377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 906/1798] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:15 2021] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:15.545707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839aa6e-e1d9-44b1-9098-c81efe28c7ec admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:15.663170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a230d-6f38-4f82-9a2a-0589c81ab28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:15.663888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a230d-6f38-4f82-9a2a-0589c81ab28c admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:15.664272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a230d-6f38-4f82-9a2a-0589c81ab28c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:15.664622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a230d-6f38-4f82-9a2a-0589c81ab28c admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:15.665357 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a230d-6f38-4f82-9a2a-0589c81ab28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:15.667568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a230d-6f38-4f82-9a2a-0589c81ab28c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:15.739569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 893/1799] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:15 2021] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:15.744601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9e71d-a576-4141-89f9-f5c38abefd85 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:15.763687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9e71d-a576-4141-89f9-f5c38abefd85 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:15.780563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2f17-d2c1-41f1-8d1a-d16ab6eea039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:15.781202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2f17-d2c1-41f1-8d1a-d16ab6eea039 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:15.781505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2f17-d2c1-41f1-8d1a-d16ab6eea039 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:15.781788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2f17-d2c1-41f1-8d1a-d16ab6eea039 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:15.782547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2f17-d2c1-41f1-8d1a-d16ab6eea039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:15.784201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2f17-d2c1-41f1-8d1a-d16ab6eea039 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:15.813746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a230d-6f38-4f82-9a2a-0589c81ab28c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:15.821376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 907/1800] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:15 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:15.830117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a230d-6f38-4f82-9a2a-0589c81ab28c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:15.844670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff357f1-3f5a-425e-9498-527f5f4d0515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:15.845667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff357f1-3f5a-425e-9498-527f5f4d0515 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:15.846108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff357f1-3f5a-425e-9498-527f5f4d0515 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:15.846699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff357f1-3f5a-425e-9498-527f5f4d0515 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:15.847681 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff357f1-3f5a-425e-9498-527f5f4d0515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:15.849756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff357f1-3f5a-425e-9498-527f5f4d0515 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:15.877877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 894/1801] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:15 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:15.884335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2f17-d2c1-41f1-8d1a-d16ab6eea039 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:15.902892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2f17-d2c1-41f1-8d1a-d16ab6eea039 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:15.915274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778d58f-12ba-432d-b726-4b13e83847a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:15.916656 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d58f-12ba-432d-b726-4b13e83847a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:15.917188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d58f-12ba-432d-b726-4b13e83847a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:15.917631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d58f-12ba-432d-b726-4b13e83847a2 admin admin] PATH_INFO: `/v3/projects/c6e167f76fcf479f99f04d200022a246/users/c196269ca3b447ba948fe17ce2b3a86b/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:15.961622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778d58f-12ba-432d-b726-4b13e83847a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e167f76fcf479f99f04d200022a246, user_id=c196269ca3b447ba948fe17ce2b3a86b, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:15.966744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778d58f-12ba-432d-b726-4b13e83847a2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:16.005306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 908/1802] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:15 2021] PUT /identity/v3/projects/c6e167f76fcf479f99f04d200022a246/users/c196269ca3b447ba948fe17ce2b3a86b/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:16.025403 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5e69-c9b4-4565-8624-f313af87b603 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:16.025698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5e69-c9b4-4565-8624-f313af87b603 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:16.026008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5e69-c9b4-4565-8624-f313af87b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:16.112989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-da7f5e69-c9b4-4565-8624-f313af87b603 None None] MFA Rules not processed for user `c196269ca3b447ba948fe17ce2b3a86b`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:16.115091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-da7f5e69-c9b4-4565-8624-f313af87b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:16.334871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 895/1803] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:16 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:16.340308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778d58f-12ba-432d-b726-4b13e83847a2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:16.436253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5e69-c9b4-4565-8624-f313af87b603 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:16.440608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-da7f5e69-c9b4-4565-8624-f313af87b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:16.473220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778d58f-12ba-432d-b726-4b13e83847a2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:16.490015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc759-2c9a-4a92-a137-c38f9c13e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:16.491577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc759-2c9a-4a92-a137-c38f9c13e32c admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:16.493050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc759-2c9a-4a92-a137-c38f9c13e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:16.494881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc759-2c9a-4a92-a137-c38f9c13e32c admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:16.495780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dc759-2c9a-4a92-a137-c38f9c13e32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:16.504544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dc759-2c9a-4a92-a137-c38f9c13e32c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:16.592399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 909/1804] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:16 2021] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:16.600001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc759-2c9a-4a92-a137-c38f9c13e32c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:16.679004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5e69-c9b4-4565-8624-f313af87b603 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:16.873497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc759-2c9a-4a92-a137-c38f9c13e32c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:16.874508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:16.876181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:16.876887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:16.877487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] PATH_INFO: `/v3/users/2621df5c30da4ea5aec35a5f3186e13a` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:16.881297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2621df5c30da4ea5aec35a5f3186e13a)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:16.884176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817b86-b844-41c5-98db-68e22d1f149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:16.885340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817b86-b844-41c5-98db-68e22d1f149d admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:16.885628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817b86-b844-41c5-98db-68e22d1f149d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:16.885905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817b86-b844-41c5-98db-68e22d1f149d admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:16.886599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:16.886728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89817b86-b844-41c5-98db-68e22d1f149d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:16.888623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89817b86-b844-41c5-98db-68e22d1f149d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:16.945703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 910/1805] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:16 2021] POST /identity/v3/users => generated 298 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:16.947550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817b86-b844-41c5-98db-68e22d1f149d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:16.973759 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817b86-b844-41c5-98db-68e22d1f149d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:16.980970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc638da4-c03e-427b-ab6c-aad0043e16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:16.981811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638da4-c03e-427b-ab6c-aad0043e16e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:16.982199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638da4-c03e-427b-ab6c-aad0043e16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:16.982887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638da4-c03e-427b-ab6c-aad0043e16e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:16.983963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc638da4-c03e-427b-ab6c-aad0043e16e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:16.985964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc638da4-c03e-427b-ab6c-aad0043e16e2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:17.020398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 911/1806] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:16 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:17.021488 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc638da4-c03e-427b-ab6c-aad0043e16e2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:17.033525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc638da4-c03e-427b-ab6c-aad0043e16e2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:17.039203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:17.040556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:17.041056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:17.041562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] PATH_INFO: `/v3/projects/3746baef911b4e08b7b4c073cfc19bf3/users/a44f70ef4e5a47ff9b9dc132de8dfb83/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:17.063439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2621df5c30da4ea5aec35a5f3186e13a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:17.067413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3746baef911b4e08b7b4c073cfc19bf3, user_id=a44f70ef4e5a47ff9b9dc132de8dfb83, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:17.071157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:17.084510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2621df5c30da4ea5aec35a5f3186e13a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:17.085927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2621df5c30da4ea5aec35a5f3186e13a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:17.087448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2621df5c30da4ea5aec35a5f3186e13a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:17.099139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-40323d52-577b-4e46-a957-4ce13e7eca0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2621df5c30da4ea5aec35a5f3186e13a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:17.101927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 912/1807] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:17 2021] PUT /identity/v3/projects/3746baef911b4e08b7b4c073cfc19bf3/users/a44f70ef4e5a47ff9b9dc132de8dfb83/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:17.106379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:17.115209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:17.122616 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 896/1808] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:16 2021] DELETE /identity/v3/users/2621df5c30da4ea5aec35a5f3186e13a => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:17.133168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cf98c-891c-4c64-928e-e38feaab2d24 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:17.133763 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cf98c-891c-4c64-928e-e38feaab2d24 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:17.134835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cf98c-891c-4c64-928e-e38feaab2d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:17.185044 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ce1cf98c-891c-4c64-928e-e38feaab2d24 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:17.186549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ce1cf98c-891c-4c64-928e-e38feaab2d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:17.276402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2d8f2-39ee-4f34-8c3b-c7d03880321f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:17.319734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 897/1809] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:17.334444 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cf98c-891c-4c64-928e-e38feaab2d24 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:17.337958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ce1cf98c-891c-4c64-928e-e38feaab2d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:17.462747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cf98c-891c-4c64-928e-e38feaab2d24 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:17.472171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76613683-0e86-4034-90cf-3eb2b4d2701c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:17.473356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613683-0e86-4034-90cf-3eb2b4d2701c service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:17.473865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613683-0e86-4034-90cf-3eb2b4d2701c service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:17.474382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613683-0e86-4034-90cf-3eb2b4d2701c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:17.476275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddfd67-9917-4421-99ac-9b5bdc0d402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:17.477031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddfd67-9917-4421-99ac-9b5bdc0d402d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:17.477425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddfd67-9917-4421-99ac-9b5bdc0d402d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:17.477827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddfd67-9917-4421-99ac-9b5bdc0d402d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:17.479473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddfd67-9917-4421-99ac-9b5bdc0d402d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:17.481233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddfd67-9917-4421-99ac-9b5bdc0d402d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:17.495776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76613683-0e86-4034-90cf-3eb2b4d2701c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:17.497485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76613683-0e86-4034-90cf-3eb2b4d2701c service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:17.507238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 913/1810] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:17 2021] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:17.509130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddfd67-9917-4421-99ac-9b5bdc0d402d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:17.510480 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 898/1811] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:17.553004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddfd67-9917-4421-99ac-9b5bdc0d402d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:17.587243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:17.587243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:17.587243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:17.587243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] PATH_INFO: `/v3/projects/3746baef911b4e08b7b4c073cfc19bf3/users/a44f70ef4e5a47ff9b9dc132de8dfb83/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:17.587760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3746baef911b4e08b7b4c073cfc19bf3, user_id=a44f70ef4e5a47ff9b9dc132de8dfb83, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:17.587760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:17.625045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 914/1812] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:17 2021] PUT /identity/v3/projects/3746baef911b4e08b7b4c073cfc19bf3/users/a44f70ef4e5a47ff9b9dc132de8dfb83/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:17.644610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690128c-c25c-49fb-9d70-cd6d4f248d58 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:17.644876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690128c-c25c-49fb-9d70-cd6d4f248d58 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:17.645196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690128c-c25c-49fb-9d70-cd6d4f248d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:17.791165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a690128c-c25c-49fb-9d70-cd6d4f248d58 None None] MFA Rules not processed for user `a44f70ef4e5a47ff9b9dc132de8dfb83`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:17.793175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a690128c-c25c-49fb-9d70-cd6d4f248d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:18.076735 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 899/1813] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:17 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:18.273318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:18.275936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:18.407250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98a70d-0807-4f36-aa8a-e61fdfbc548e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:18.412116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:18.412839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:18.413546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:18.413937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:18.427260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:18.428915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:18.441966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 915/1814] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:18 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:18.644013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690128c-c25c-49fb-9d70-cd6d4f248d58 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:18.660724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690128c-c25c-49fb-9d70-cd6d4f248d58 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:18.669705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:18.670919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:18.671633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:18.672120 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:18.676589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:18.835436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:18.836957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:18.896518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:18.898338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:18.923701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 900/1815] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:18 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:18.999914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0183a-4d9e-49be-9db5-947e03a71c29 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:19.004497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:19.005344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:19.005632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:19.005931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] PATH_INFO: `/v3/projects/ae5c7f3eae8d4f65903e599c4a20b28a` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:19.007222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5c7f3eae8d4f65903e599c4a20b28a)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:19.009887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:19.070947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5c7f3eae8d4f65903e599c4a20b28a', 'request_id': 'req-4112d528-2c77-41b2-bf63-6c57069a075a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.078286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5c7f3eae8d4f65903e599c4a20b28a', 'request_id': 'req-4112d528-2c77-41b2-bf63-6c57069a075a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.089760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5c7f3eae8d4f65903e599c4a20b28a', 'request_id': 'req-4112d528-2c77-41b2-bf63-6c57069a075a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.110056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] The token cache is being invalidate because project ae5c7f3eae8d4f65903e599c4a20b28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:19.110328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.111307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.113777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 916/1816] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:18 2021] DELETE /identity/v3/projects/ae5c7f3eae8d4f65903e599c4a20b28a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:19.117723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:19.131167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a0403-5448-4ef1-912b-75fa26d85076 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:19.222604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:19.223774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:19.224243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:19.224600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] PATH_INFO: `/v3/users/39d8d8abca7d46559b029febffebf5a2` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:19.225898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d8d8abca7d46559b029febffebf5a2)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:19.228982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:19.285261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d8d8abca7d46559b029febffebf5a2'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.294307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d8d8abca7d46559b029febffebf5a2'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.295254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d8d8abca7d46559b029febffebf5a2'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.295971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d8d8abca7d46559b029febffebf5a2'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.305861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5da58e23-abd3-4ede-aa5b-d354f16b82ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d8d8abca7d46559b029febffebf5a2'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.324021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 901/1817] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:19 2021] DELETE /identity/v3/users/39d8d8abca7d46559b029febffebf5a2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:19.374780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:19.377511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:19.392105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112d528-2c77-41b2-bf63-6c57069a075a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:19.495502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:19.496343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:19.496631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:19.496914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] PATH_INFO: `/v3/users/c196269ca3b447ba948fe17ce2b3a86b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:19.498130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c196269ca3b447ba948fe17ce2b3a86b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:19.500149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:19.561860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c196269ca3b447ba948fe17ce2b3a86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.573252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c196269ca3b447ba948fe17ce2b3a86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.574368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c196269ca3b447ba948fe17ce2b3a86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.575381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c196269ca3b447ba948fe17ce2b3a86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.595590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c196269ca3b447ba948fe17ce2b3a86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.617563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 917/1818] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:19 2021] DELETE /identity/v3/users/c196269ca3b447ba948fe17ce2b3a86b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:19.623150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a27c4-012f-4c9a-82bf-afc87c3a6896 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:19.623622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a27c4-012f-4c9a-82bf-afc87c3a6896 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:19.624001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a27c4-012f-4c9a-82bf-afc87c3a6896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:19.647685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-bd5a27c4-012f-4c9a-82bf-afc87c3a6896 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:19.648897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bd5a27c4-012f-4c9a-82bf-afc87c3a6896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:19.740962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 902/1819] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:19.758240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:19.760105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:19.798915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a27c4-012f-4c9a-82bf-afc87c3a6896 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:19.800468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bd5a27c4-012f-4c9a-82bf-afc87c3a6896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:19.813463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a27c4-012f-4c9a-82bf-afc87c3a6896 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:19.819987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:19.821064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:19.821494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:19.821943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] PATH_INFO: `/v3/projects/a88463824ab84410be2ddd1b9e68d50c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:19.824022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88463824ab84410be2ddd1b9e68d50c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:19.828281 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:19.851357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1426968-21bf-4ef8-82a4-03f2d1ae83f4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:19.855750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bf40a-5d2f-4222-96fd-ca53b300a887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:19.856568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bf40a-5d2f-4222-96fd-ca53b300a887 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:19.856930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bf40a-5d2f-4222-96fd-ca53b300a887 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:19.857219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bf40a-5d2f-4222-96fd-ca53b300a887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:19.868089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bf40a-5d2f-4222-96fd-ca53b300a887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:19.869597 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bf40a-5d2f-4222-96fd-ca53b300a887 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:19.885285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 918/1820] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:19.909382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88463824ab84410be2ddd1b9e68d50c', 'request_id': 'req-557b8795-71a2-4f22-b019-2c668667442f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.916706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88463824ab84410be2ddd1b9e68d50c', 'request_id': 'req-557b8795-71a2-4f22-b019-2c668667442f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.927103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88463824ab84410be2ddd1b9e68d50c', 'request_id': 'req-557b8795-71a2-4f22-b019-2c668667442f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.951884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] The token cache is being invalidate because project a88463824ab84410be2ddd1b9e68d50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:19.952656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.954028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-557b8795-71a2-4f22-b019-2c668667442f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:19.955910 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 903/1821] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:19 2021] DELETE /identity/v3/projects/a88463824ab84410be2ddd1b9e68d50c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:19.961894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638088ac-1f2e-4995-9203-c97fff7936d6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:19.962192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638088ac-1f2e-4995-9203-c97fff7936d6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:19.963432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638088ac-1f2e-4995-9203-c97fff7936d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:19.990028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-638088ac-1f2e-4995-9203-c97fff7936d6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:19.991941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-638088ac-1f2e-4995-9203-c97fff7936d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:20.093578 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 919/1822] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:20.103247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86bbc0-bd91-413d-a18f-ff6bcebb2a8c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.103546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86bbc0-bd91-413d-a18f-ff6bcebb2a8c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.103834 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86bbc0-bd91-413d-a18f-ff6bcebb2a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.132652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-9a86bbc0-bd91-413d-a18f-ff6bcebb2a8c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:20.132652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9a86bbc0-bd91-413d-a18f-ff6bcebb2a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:20.144768 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 904/1823] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:20.154649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638088ac-1f2e-4995-9203-c97fff7936d6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.173404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638088ac-1f2e-4995-9203-c97fff7936d6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.181729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.182971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.183472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.183976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.185280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:20.185822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.189013 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.214566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 920/1824] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:20.220161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86bbc0-bd91-413d-a18f-ff6bcebb2a8c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.230641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86bbc0-bd91-413d-a18f-ff6bcebb2a8c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.236498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82777b-9bde-4e15-9e2e-f2c65be0ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.236967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82777b-9bde-4e15-9e2e-f2c65be0ea34 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.237972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82777b-9bde-4e15-9e2e-f2c65be0ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.237972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82777b-9bde-4e15-9e2e-f2c65be0ea34 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.238476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82777b-9bde-4e15-9e2e-f2c65be0ea34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.240592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82777b-9bde-4e15-9e2e-f2c65be0ea34 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.286484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 905/1825] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:20 2021] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:20.289388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.307245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8193c-87a4-4fe7-8811-cdf1cb065155 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.399670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.401314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.401758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.402319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.403603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.407368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.441429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 921/1826] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:20 2021] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:20.447732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82777b-9bde-4e15-9e2e-f2c65be0ea34 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.455690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.458136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:20.459882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82777b-9bde-4e15-9e2e-f2c65be0ea34 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.465302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68514d26-0291-434f-963b-0ff11073b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.466108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68514d26-0291-434f-963b-0ff11073b440 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.466430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68514d26-0291-434f-963b-0ff11073b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.467422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68514d26-0291-434f-963b-0ff11073b440 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.468157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68514d26-0291-434f-963b-0ff11073b440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.470379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc7a9-77ba-420a-be26-cb5ed9bcc2a4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.470644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68514d26-0291-434f-963b-0ff11073b440 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.475625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.476466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.476751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.477034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] PATH_INFO: `/v3/projects/c6e167f76fcf479f99f04d200022a246` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.478255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e167f76fcf479f99f04d200022a246)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.480234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.488250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 906/1827] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:20 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:58:20.488633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68514d26-0291-434f-963b-0ff11073b440 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.500081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68514d26-0291-434f-963b-0ff11073b440 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.504946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0da0c-ff26-477c-a4aa-65759a7c36ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.505558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0da0c-ff26-477c-a4aa-65759a7c36ca admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.505849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0da0c-ff26-477c-a4aa-65759a7c36ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.506130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0da0c-ff26-477c-a4aa-65759a7c36ca admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.506902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0da0c-ff26-477c-a4aa-65759a7c36ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.508536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0da0c-ff26-477c-a4aa-65759a7c36ca admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.520048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 907/1828] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:20.526858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0da0c-ff26-477c-a4aa-65759a7c36ca admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.542739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0da0c-ff26-477c-a4aa-65759a7c36ca admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.555699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e167f76fcf479f99f04d200022a246', 'request_id': 'req-2814055a-346d-4251-a2bd-eaaf9f31db18'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.565679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e167f76fcf479f99f04d200022a246', 'request_id': 'req-2814055a-346d-4251-a2bd-eaaf9f31db18'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.579481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e167f76fcf479f99f04d200022a246', 'request_id': 'req-2814055a-346d-4251-a2bd-eaaf9f31db18'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.616263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] The token cache is being invalidate because project c6e167f76fcf479f99f04d200022a246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:20.616781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.618044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.621125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 922/1829] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:20 2021] DELETE /identity/v3/projects/c6e167f76fcf479f99f04d200022a246 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:20.625859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.627841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:20.643091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67167f7-dc4c-4983-a330-b3e9b3ad79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.643995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67167f7-dc4c-4983-a330-b3e9b3ad79e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.644305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67167f7-dc4c-4983-a330-b3e9b3ad79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.644587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67167f7-dc4c-4983-a330-b3e9b3ad79e3 admin admin] PATH_INFO: `/v3/projects/d73a9271cceb4cc188719998aa8917ee/users/eced3bd278a44ae288b91359ef6ed45e/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.669288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67167f7-dc4c-4983-a330-b3e9b3ad79e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73a9271cceb4cc188719998aa8917ee, user_id=eced3bd278a44ae288b91359ef6ed45e, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.674427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67167f7-dc4c-4983-a330-b3e9b3ad79e3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.703048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 908/1830] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:20 2021] PUT /identity/v3/projects/d73a9271cceb4cc188719998aa8917ee/users/eced3bd278a44ae288b91359ef6ed45e/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:20.713806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ba126-d906-4c13-8480-da9b6011979e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.714109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ba126-d906-4c13-8480-da9b6011979e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.714421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ba126-d906-4c13-8480-da9b6011979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.763343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8c4ba126-d906-4c13-8480-da9b6011979e None None] MFA Rules not processed for user `eced3bd278a44ae288b91359ef6ed45e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:20.764380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814055a-346d-4251-a2bd-eaaf9f31db18 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.764693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8c4ba126-d906-4c13-8480-da9b6011979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:20.868425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 909/1831] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:20 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:20.870380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ba126-d906-4c13-8480-da9b6011979e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.871718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8c4ba126-d906-4c13-8480-da9b6011979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:20.874668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.875865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.876357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.876858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] PATH_INFO: `/v3/users/a44f70ef4e5a47ff9b9dc132de8dfb83` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.878584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44f70ef4e5a47ff9b9dc132de8dfb83)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.882296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.887271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ba126-d906-4c13-8480-da9b6011979e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:20.891828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bb266-de86-4009-8118-59ae11482802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:20.892434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bb266-de86-4009-8118-59ae11482802 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:20.892754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bb266-de86-4009-8118-59ae11482802 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:20.893033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bb266-de86-4009-8118-59ae11482802 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:20.893734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bb266-de86-4009-8118-59ae11482802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:20.895698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bb266-de86-4009-8118-59ae11482802 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:20.926530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 910/1832] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:20 2021] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:20.932728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bb266-de86-4009-8118-59ae11482802 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:20.959732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44f70ef4e5a47ff9b9dc132de8dfb83'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.969450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44f70ef4e5a47ff9b9dc132de8dfb83'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.970442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44f70ef4e5a47ff9b9dc132de8dfb83'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.971307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44f70ef4e5a47ff9b9dc132de8dfb83'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:20.986899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44f70ef4e5a47ff9b9dc132de8dfb83'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:21.004910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 923/1833] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:20 2021] DELETE /identity/v3/users/a44f70ef4e5a47ff9b9dc132de8dfb83 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:21.023155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bb266-de86-4009-8118-59ae11482802 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:21.158788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d271c5b-50a6-46ed-9b93-6f9c332eae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:21.159712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271c5b-50a6-46ed-9b93-6f9c332eae80 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:21.160175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271c5b-50a6-46ed-9b93-6f9c332eae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:21.160630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271c5b-50a6-46ed-9b93-6f9c332eae80 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:21.161702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d271c5b-50a6-46ed-9b93-6f9c332eae80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:21.165372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d271c5b-50a6-46ed-9b93-6f9c332eae80 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:21.201202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 911/1834] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:20 2021] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:21.203599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:21.206379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:21.224139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677f4a4-cd06-44cf-ab8e-fcd3b3369e26 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:21.230975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11171c1-32c1-44c8-9979-c29dfbd086d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:21.232398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11171c1-32c1-44c8-9979-c29dfbd086d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:21.233526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11171c1-32c1-44c8-9979-c29dfbd086d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:21.234151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11171c1-32c1-44c8-9979-c29dfbd086d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:21.235775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11171c1-32c1-44c8-9979-c29dfbd086d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:21.239186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11171c1-32c1-44c8-9979-c29dfbd086d9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:21.260787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 924/1835] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:21 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:21.262374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d271c5b-50a6-46ed-9b93-6f9c332eae80 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:21.273407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d271c5b-50a6-46ed-9b93-6f9c332eae80 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:21.282756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07423-9fc6-4bb3-aa8f-3b1977965287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:21.283609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07423-9fc6-4bb3-aa8f-3b1977965287 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:21.284052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07423-9fc6-4bb3-aa8f-3b1977965287 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:21.284340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07423-9fc6-4bb3-aa8f-3b1977965287 admin admin] PATH_INFO: `/v3/projects/714176c520ab4c6791fbab0e0e3c02f0/users/adebd94702a64ac4a3581a3f14432940/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:21.307718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f07423-9fc6-4bb3-aa8f-3b1977965287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714176c520ab4c6791fbab0e0e3c02f0, user_id=adebd94702a64ac4a3581a3f14432940, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:21.310443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f07423-9fc6-4bb3-aa8f-3b1977965287 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:21.335289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 912/1836] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:21 2021] PUT /identity/v3/projects/714176c520ab4c6791fbab0e0e3c02f0/users/adebd94702a64ac4a3581a3f14432940/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:21.342658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11171c1-32c1-44c8-9979-c29dfbd086d9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:21.356341 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11171c1-32c1-44c8-9979-c29dfbd086d9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:21.445927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e84d1f-2083-4e69-a2e5-d8592d6a0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:21.447196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e84d1f-2083-4e69-a2e5-d8592d6a0521 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:21.447196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e84d1f-2083-4e69-a2e5-d8592d6a0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:21.447196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e84d1f-2083-4e69-a2e5-d8592d6a0521 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:21.447866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e84d1f-2083-4e69-a2e5-d8592d6a0521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:21.449503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e84d1f-2083-4e69-a2e5-d8592d6a0521 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:21.460693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 925/1837] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:21 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:21.467331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07423-9fc6-4bb3-aa8f-3b1977965287 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:21.485341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07423-9fc6-4bb3-aa8f-3b1977965287 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:21.490669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:21.491471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:21.491762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:21.492052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] PATH_INFO: `/v3/projects/714176c520ab4c6791fbab0e0e3c02f0/users/adebd94702a64ac4a3581a3f14432940/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:21.494068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] RBAC: Authorizing `identity:create_grant(project_id=714176c520ab4c6791fbab0e0e3c02f0, user_id=adebd94702a64ac4a3581a3f14432940, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:21.496834 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:21.510618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 913/1838] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:21 2021] PUT /identity/v3/projects/714176c520ab4c6791fbab0e0e3c02f0/users/adebd94702a64ac4a3581a3f14432940/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:21.530057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31713c8-2046-49b2-bdce-81542a8c4664 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:21.530623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31713c8-2046-49b2-bdce-81542a8c4664 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:21.531105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31713c8-2046-49b2-bdce-81542a8c4664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:21.618945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b31713c8-2046-49b2-bdce-81542a8c4664 None None] MFA Rules not processed for user `adebd94702a64ac4a3581a3f14432940`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:21.620442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b31713c8-2046-49b2-bdce-81542a8c4664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:21.687390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:21.689284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:21.768708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 926/1839] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:21 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:21.790458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31713c8-2046-49b2-bdce-81542a8c4664 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:21.792686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b31713c8-2046-49b2-bdce-81542a8c4664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:21.885438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664c49-d65c-420a-b4b0-0070ac34532d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:21.893800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:21.897698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:21.898393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:21.898648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] PATH_INFO: `/v3/projects/3746baef911b4e08b7b4c073cfc19bf3` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:21.902785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3746baef911b4e08b7b4c073cfc19bf3)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:21.905323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:21.928551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31713c8-2046-49b2-bdce-81542a8c4664 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:21.935550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6ef89-6739-414f-8932-32eb284ab13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:21.937192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6ef89-6739-414f-8932-32eb284ab13c service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:21.938081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6ef89-6739-414f-8932-32eb284ab13c service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:21.938934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6ef89-6739-414f-8932-32eb284ab13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:21.960504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6ef89-6739-414f-8932-32eb284ab13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:21.963910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6ef89-6739-414f-8932-32eb284ab13c service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.003743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3746baef911b4e08b7b4c073cfc19bf3', 'request_id': 'req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.004828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 927/1840] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:21 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:22.011917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3746baef911b4e08b7b4c073cfc19bf3', 'request_id': 'req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.037982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3746baef911b4e08b7b4c073cfc19bf3', 'request_id': 'req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.063708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] The token cache is being invalidate because project 3746baef911b4e08b7b4c073cfc19bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:22.064279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.065138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.067537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 914/1841] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:21 2021] DELETE /identity/v3/projects/3746baef911b4e08b7b4c073cfc19bf3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:22.077152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82e98-d8a9-4094-a136-dbc7caa2007f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.077436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82e98-d8a9-4094-a136-dbc7caa2007f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.077874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82e98-d8a9-4094-a136-dbc7caa2007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.105419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:22.108860 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:22.119343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7ef82e98-d8a9-4094-a136-dbc7caa2007f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:22.121237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7ef82e98-d8a9-4094-a136-dbc7caa2007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:22.234859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3ad61-e210-4ddd-ab8c-8e042cdaf558 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:22.237898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 928/1842] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:22.242437 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:22.244306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.244800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.245302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] PATH_INFO: `/v3/users/eced3bd278a44ae288b91359ef6ed45e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.247402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eced3bd278a44ae288b91359ef6ed45e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:22.250720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.251578 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca9e5-793a-4d53-a373-e4adf2539eba None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.252084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca9e5-793a-4d53-a373-e4adf2539eba None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.252376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca9e5-793a-4d53-a373-e4adf2539eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.279693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-27dca9e5-793a-4d53-a373-e4adf2539eba None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:22.281087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-27dca9e5-793a-4d53-a373-e4adf2539eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:22.296667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 929/1843] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:22.302690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dca9e5-793a-4d53-a373-e4adf2539eba None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:22.317482 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eced3bd278a44ae288b91359ef6ed45e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.324384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dca9e5-793a-4d53-a373-e4adf2539eba None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:22.327391 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eced3bd278a44ae288b91359ef6ed45e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.328232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eced3bd278a44ae288b91359ef6ed45e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.328989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eced3bd278a44ae288b91359ef6ed45e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.330928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:22.332709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.333237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.333589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.334453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:22.334806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:22.336586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.340494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c3f6c50b-def4-4c7c-bc77-2b8167661da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eced3bd278a44ae288b91359ef6ed45e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:22.354899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 930/1844] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:22.359886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:22.364677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:22.378850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 915/1845] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:22 2021] DELETE /identity/v3/users/eced3bd278a44ae288b91359ef6ed45e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:22.383328 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e800db-9272-49dd-8550-2ff88df7aaf6 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.383561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e800db-9272-49dd-8550-2ff88df7aaf6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.383924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e800db-9272-49dd-8550-2ff88df7aaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.386623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ad42-99a5-4869-bf55-43daccc088c4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:22.408908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f9e800db-9272-49dd-8550-2ff88df7aaf6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:22.410260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f9e800db-9272-49dd-8550-2ff88df7aaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:22.484153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc189cf-62e3-42cd-afa9-4fa2ad723caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:22.485030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc189cf-62e3-42cd-afa9-4fa2ad723caf admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.485264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc189cf-62e3-42cd-afa9-4fa2ad723caf admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.485550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc189cf-62e3-42cd-afa9-4fa2ad723caf admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.486517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc189cf-62e3-42cd-afa9-4fa2ad723caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:22.488549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc189cf-62e3-42cd-afa9-4fa2ad723caf admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.535120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 931/1846] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:22 2021] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:22.539725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 916/1847] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:22.546451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc189cf-62e3-42cd-afa9-4fa2ad723caf admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:22.560845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e800db-9272-49dd-8550-2ff88df7aaf6 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:22.563272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f9e800db-9272-49dd-8550-2ff88df7aaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:22.644815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc189cf-62e3-42cd-afa9-4fa2ad723caf admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:22.650386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e5eb-2bcb-4052-92bf-2ace7cc5bff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:22.651231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e5eb-2bcb-4052-92bf-2ace7cc5bff8 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.651987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e5eb-2bcb-4052-92bf-2ace7cc5bff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.652376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e5eb-2bcb-4052-92bf-2ace7cc5bff8 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.653134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8e5eb-2bcb-4052-92bf-2ace7cc5bff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:22.655421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8e5eb-2bcb-4052-92bf-2ace7cc5bff8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.687354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 932/1848] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:22 2021] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:22.688588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e5eb-2bcb-4052-92bf-2ace7cc5bff8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:22.702197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e5eb-2bcb-4052-92bf-2ace7cc5bff8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:22.703402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e800db-9272-49dd-8550-2ff88df7aaf6 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:22.708442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2010-194c-482f-b461-22dd934bdbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:22.709207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2010-194c-482f-b461-22dd934bdbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.709600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2010-194c-482f-b461-22dd934bdbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.710614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2010-194c-482f-b461-22dd934bdbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.711587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf2010-194c-482f-b461-22dd934bdbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:22.714558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf2010-194c-482f-b461-22dd934bdbc2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.732773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 933/1849] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:22 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:22.733992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2010-194c-482f-b461-22dd934bdbc2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:22.764890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2010-194c-482f-b461-22dd934bdbc2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:22.773641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbe4cd-d832-419d-a955-e35d4b5e4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:22.776024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe4cd-d832-419d-a955-e35d4b5e4f96 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.776024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe4cd-d832-419d-a955-e35d4b5e4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.776421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe4cd-d832-419d-a955-e35d4b5e4f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.777791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbe4cd-d832-419d-a955-e35d4b5e4f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:22.780482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbe4cd-d832-419d-a955-e35d4b5e4f96 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.804293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 934/1850] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:22 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:22.810883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbe4cd-d832-419d-a955-e35d4b5e4f96 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:22.858126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbe4cd-d832-419d-a955-e35d4b5e4f96 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:22.877182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba465a4-38f5-4db8-ad6c-e28b49e448ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:22.881392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba465a4-38f5-4db8-ad6c-e28b49e448ed admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.881956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba465a4-38f5-4db8-ad6c-e28b49e448ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.883027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba465a4-38f5-4db8-ad6c-e28b49e448ed admin admin] PATH_INFO: `/v3/projects/ccbb76292ff94c57a48ed3833187805d/users/7feb8b5d7717496ca93d7fea64a89ca0/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.916682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3586-3a2c-42dc-8a3d-988d2f2bb521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:22.917288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3586-3a2c-42dc-8a3d-988d2f2bb521 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.918889 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3586-3a2c-42dc-8a3d-988d2f2bb521 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.919191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3586-3a2c-42dc-8a3d-988d2f2bb521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.937259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba465a4-38f5-4db8-ad6c-e28b49e448ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbb76292ff94c57a48ed3833187805d, user_id=7feb8b5d7717496ca93d7fea64a89ca0, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:22.939670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba465a4-38f5-4db8-ad6c-e28b49e448ed admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.943685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c3586-3a2c-42dc-8a3d-988d2f2bb521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:22.946425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c3586-3a2c-42dc-8a3d-988d2f2bb521 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:22.959598 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 935/1851] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:22 2021] PUT /identity/v3/projects/ccbb76292ff94c57a48ed3833187805d/users/7feb8b5d7717496ca93d7fea64a89ca0/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:22.967427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248506d-852c-41e9-9f84-3b3efd0e2710 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:22.968235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248506d-852c-41e9-9f84-3b3efd0e2710 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:22.968718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248506d-852c-41e9-9f84-3b3efd0e2710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:22.978871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 917/1852] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:23.002575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f248506d-852c-41e9-9f84-3b3efd0e2710 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:23.004029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f248506d-852c-41e9-9f84-3b3efd0e2710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:23.189908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 936/1853] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:23.208229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3586-3a2c-42dc-8a3d-988d2f2bb521 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:23.229432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3586-3a2c-42dc-8a3d-988d2f2bb521 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:23.367075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68df93-826e-447c-a6c9-c969254191f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:23.367674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68df93-826e-447c-a6c9-c969254191f0 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:23.367968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68df93-826e-447c-a6c9-c969254191f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:23.368933 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68df93-826e-447c-a6c9-c969254191f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:23.381514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68df93-826e-447c-a6c9-c969254191f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:23.385044 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68df93-826e-447c-a6c9-c969254191f0 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:23.406137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 918/1854] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:23.513551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248506d-852c-41e9-9f84-3b3efd0e2710 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:23.516275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f248506d-852c-41e9-9f84-3b3efd0e2710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:23.546302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248506d-852c-41e9-9f84-3b3efd0e2710 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:23.554267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:23.555814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:23.556935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:23.557521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] PATH_INFO: `/v3/projects/d73a9271cceb4cc188719998aa8917ee` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:23.559871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73a9271cceb4cc188719998aa8917ee)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:23.563941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:23.669281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73a9271cceb4cc188719998aa8917ee', 'request_id': 'req-48ed6073-87df-44a6-b3a6-4631cca45e68'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:23.679176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73a9271cceb4cc188719998aa8917ee', 'request_id': 'req-48ed6073-87df-44a6-b3a6-4631cca45e68'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:23.691472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73a9271cceb4cc188719998aa8917ee', 'request_id': 'req-48ed6073-87df-44a6-b3a6-4631cca45e68'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:23.725061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] The token cache is being invalidate because project d73a9271cceb4cc188719998aa8917ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:23.725623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:23.743017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:23.745918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 937/1855] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:23 2021] DELETE /identity/v3/projects/d73a9271cceb4cc188719998aa8917ee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:23.753026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68df93-826e-447c-a6c9-c969254191f0 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:23.770706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68df93-826e-447c-a6c9-c969254191f0 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:23.846881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:23.848495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:23.892643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:23.894615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:23.895320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:23.896055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] PATH_INFO: `/v3/users/adebd94702a64ac4a3581a3f14432940` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:23.899123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adebd94702a64ac4a3581a3f14432940)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:23.903230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:23.962946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6073-87df-44a6-b3a6-4631cca45e68 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:23.969099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:23.969775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:23.970129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:23.970664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] PATH_INFO: `/v3/users/0a8a7aee924b4732a06fb20fd7ece8dc` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:23.971841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8a7aee924b4732a06fb20fd7ece8dc)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:23.973916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:23.986219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adebd94702a64ac4a3581a3f14432940'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:23.997258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adebd94702a64ac4a3581a3f14432940'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:23.998132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adebd94702a64ac4a3581a3f14432940'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:24.000038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adebd94702a64ac4a3581a3f14432940'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:24.012088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6b1e3ace-7288-4407-9451-a06da135dc71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adebd94702a64ac4a3581a3f14432940'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:24.036818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 919/1856] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:23 2021] DELETE /identity/v3/users/adebd94702a64ac4a3581a3f14432940 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:24.048344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8a7aee924b4732a06fb20fd7ece8dc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:24.061700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8a7aee924b4732a06fb20fd7ece8dc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:24.062984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8a7aee924b4732a06fb20fd7ece8dc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:24.064440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8a7aee924b4732a06fb20fd7ece8dc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:24.085138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8a7aee924b4732a06fb20fd7ece8dc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:24.118002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 938/1857] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:23 2021] DELETE /identity/v3/users/0a8a7aee924b4732a06fb20fd7ece8dc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:24.126261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93436-aef1-42b4-bedd-411601846355 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:24.126455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93436-aef1-42b4-bedd-411601846355 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:24.127033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93436-aef1-42b4-bedd-411601846355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:24.198272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-88c93436-aef1-42b4-bedd-411601846355 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:24.201825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-88c93436-aef1-42b4-bedd-411601846355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:24.362557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 920/1858] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:24.398985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:24.402216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:24.579057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a78662-89fc-4e89-8255-361e5d51e944 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:24.585220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1002479-ab32-499a-9699-e9267f5e6f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:24.586313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1002479-ab32-499a-9699-e9267f5e6f7e service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:24.587012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1002479-ab32-499a-9699-e9267f5e6f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:24.587512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1002479-ab32-499a-9699-e9267f5e6f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:24.604491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1002479-ab32-499a-9699-e9267f5e6f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:24.607976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1002479-ab32-499a-9699-e9267f5e6f7e service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:24.627269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 939/1859] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:25.177883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93436-aef1-42b4-bedd-411601846355 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:25.182910 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-88c93436-aef1-42b4-bedd-411601846355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:25.210661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93436-aef1-42b4-bedd-411601846355 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:25.218222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:25.219782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:25.220424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:25.221545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] PATH_INFO: `/v3/projects/714176c520ab4c6791fbab0e0e3c02f0` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:25.223326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=714176c520ab4c6791fbab0e0e3c02f0)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:25.227216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:25.264500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7771-e982-4b29-8c40-7640481e6217 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:25.265147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7771-e982-4b29-8c40-7640481e6217 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:25.265910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7771-e982-4b29-8c40-7640481e6217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:25.378562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c8bc7771-e982-4b29-8c40-7640481e6217 None None] MFA Rules not processed for user `7feb8b5d7717496ca93d7fea64a89ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:25.382907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c8bc7771-e982-4b29-8c40-7640481e6217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:25.395374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714176c520ab4c6791fbab0e0e3c02f0', 'request_id': 'req-11237e8b-0af6-4428-8c21-dda8e3f2b78f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:25.421508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714176c520ab4c6791fbab0e0e3c02f0', 'request_id': 'req-11237e8b-0af6-4428-8c21-dda8e3f2b78f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:25.445635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714176c520ab4c6791fbab0e0e3c02f0', 'request_id': 'req-11237e8b-0af6-4428-8c21-dda8e3f2b78f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:25.488433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] The token cache is being invalidate because project 714176c520ab4c6791fbab0e0e3c02f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:25.488905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:25.490027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-11237e8b-0af6-4428-8c21-dda8e3f2b78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:25.506557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 921/1860] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:25 2021] DELETE /identity/v3/projects/714176c520ab4c6791fbab0e0e3c02f0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:25.510250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ade1-1d3e-42f3-988b-760187acfbf6 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:25.515290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ade1-1d3e-42f3-988b-760187acfbf6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:25.516922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ade1-1d3e-42f3-988b-760187acfbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:25.581150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 940/1861] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:25 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:25.582174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c505ade1-1d3e-42f3-988b-760187acfbf6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:25.588604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7771-e982-4b29-8c40-7640481e6217 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:25.589808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c505ade1-1d3e-42f3-988b-760187acfbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:25.591987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c8bc7771-e982-4b29-8c40-7640481e6217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:25.709320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7771-e982-4b29-8c40-7640481e6217 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:25.716895 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728caa-07ca-46b3-848d-65b458c00105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:25.717801 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728caa-07ca-46b3-848d-65b458c00105 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:25.718256 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728caa-07ca-46b3-848d-65b458c00105 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:25.718726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728caa-07ca-46b3-848d-65b458c00105 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:25.719632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728caa-07ca-46b3-848d-65b458c00105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:25.722521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728caa-07ca-46b3-848d-65b458c00105 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:25.769185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 941/1862] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:25 2021] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:25.774825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728caa-07ca-46b3-848d-65b458c00105 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:25.795465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 922/1863] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:25.809338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345771-6279-41bc-9539-15a3a46a03a5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:25.810194 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345771-6279-41bc-9539-15a3a46a03a5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:25.813221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345771-6279-41bc-9539-15a3a46a03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:25.910334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-67345771-6279-41bc-9539-15a3a46a03a5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:25.915645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-67345771-6279-41bc-9539-15a3a46a03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:25.994691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728caa-07ca-46b3-848d-65b458c00105 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.005529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbff13-b2ec-49bb-9865-01da4f251707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.006984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbff13-b2ec-49bb-9865-01da4f251707 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.007487 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbff13-b2ec-49bb-9865-01da4f251707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.007995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbff13-b2ec-49bb-9865-01da4f251707 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.009369 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbff13-b2ec-49bb-9865-01da4f251707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.014727 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbff13-b2ec-49bb-9865-01da4f251707 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:26.019714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 923/1864] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:26.020911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67345771-6279-41bc-9539-15a3a46a03a5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.023434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-67345771-6279-41bc-9539-15a3a46a03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:26.038285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67345771-6279-41bc-9539-15a3a46a03a5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.045174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.045995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.046309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.046835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] PATH_INFO: `/v3/projects/b5959a23f6a24fb6a824a7618dd315b3` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.048089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5959a23f6a24fb6a824a7618dd315b3)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.050076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:26.092186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 942/1865] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:25 2021] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:26.094696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbff13-b2ec-49bb-9865-01da4f251707 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.119918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5959a23f6a24fb6a824a7618dd315b3', 'request_id': 'req-f8960c79-064a-4ef7-88d3-9be2244daa86'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.120457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbff13-b2ec-49bb-9865-01da4f251707 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.126749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5959a23f6a24fb6a824a7618dd315b3', 'request_id': 'req-f8960c79-064a-4ef7-88d3-9be2244daa86'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.138045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5959a23f6a24fb6a824a7618dd315b3', 'request_id': 'req-f8960c79-064a-4ef7-88d3-9be2244daa86'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.159255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] The token cache is being invalidate because project b5959a23f6a24fb6a824a7618dd315b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:26.159544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.160416 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.162205 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 924/1866] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:26 2021] DELETE /identity/v3/projects/b5959a23f6a24fb6a824a7618dd315b3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:26.163059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.164531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:26.259259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8960c79-064a-4ef7-88d3-9be2244daa86 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.264740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.265365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.265778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.266065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.267010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.268800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:26.270094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.271152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.271675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.272185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.273450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:26.273962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.277617 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:26.282213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 925/1867] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:26 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:26.283130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.289195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:26.304273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c849da-7aa1-46ac-b26f-d491dde6d005 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.307054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 943/1868] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:26.309543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.310937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.311961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.312254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.312540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] PATH_INFO: `/v3/users/b99f4b090dfc42bd90d6b606d14a7870` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.313885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99f4b090dfc42bd90d6b606d14a7870)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.316267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:26.330687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7ec5-efdc-453b-9614-6f6a05220a91 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.339502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.342007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.342840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.343574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] PATH_INFO: `/v3/projects/371ee3d385e0484db19eb9102133598c/users/670bde456aae4c1fbc52123d7c9951d5/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.412301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] RBAC: Authorizing `identity:create_grant(project_id=371ee3d385e0484db19eb9102133598c, user_id=670bde456aae4c1fbc52123d7c9951d5, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.421299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:26.435779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99f4b090dfc42bd90d6b606d14a7870'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.454627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 944/1869] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:26 2021] PUT /identity/v3/projects/371ee3d385e0484db19eb9102133598c/users/670bde456aae4c1fbc52123d7c9951d5/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:26.454627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.454627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:26.459336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99f4b090dfc42bd90d6b606d14a7870'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.465012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99f4b090dfc42bd90d6b606d14a7870'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.467825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99f4b090dfc42bd90d6b606d14a7870'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.492822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99f4b090dfc42bd90d6b606d14a7870'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:26.548607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 926/1870] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:26 2021] DELETE /identity/v3/users/b99f4b090dfc42bd90d6b606d14a7870 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:26.548607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.551370 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:26.580844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b328-09a0-4f42-899b-219d22d3372f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.714388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.715706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.716468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.717134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.718991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.721577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:26.776305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 945/1871] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:26 2021] POST /identity/v3/projects => generated 383 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:26.788499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.790984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:26.819939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a648b2-f50b-4780-bfc4-f789b27b4faf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.936708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03909f6-dd74-479a-b39b-e3c9187f2acd admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.942067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f006f-8461-41df-9dbb-6f9abce9f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.942738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f006f-8461-41df-9dbb-6f9abce9f332 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.943029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f006f-8461-41df-9dbb-6f9abce9f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.943315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f006f-8461-41df-9dbb-6f9abce9f332 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.943964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f006f-8461-41df-9dbb-6f9abce9f332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.945950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f006f-8461-41df-9dbb-6f9abce9f332 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:26.974679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 946/1872] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:26 2021] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:26.978120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f006f-8461-41df-9dbb-6f9abce9f332 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:26.989477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f006f-8461-41df-9dbb-6f9abce9f332 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:26.995455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04a49-4ed4-4243-923d-dabf8c4e3483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:26.996138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04a49-4ed4-4243-923d-dabf8c4e3483 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:26.996523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04a49-4ed4-4243-923d-dabf8c4e3483 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:26.996899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04a49-4ed4-4243-923d-dabf8c4e3483 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:26.997710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04a49-4ed4-4243-923d-dabf8c4e3483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:26.999638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04a49-4ed4-4243-923d-dabf8c4e3483 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.009582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d4e4-f15d-48dc-bbbb-e05b0f630025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:27.011790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d4e4-f15d-48dc-bbbb-e05b0f630025 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.012068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 947/1873] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:26 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:27.012938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d4e4-f15d-48dc-bbbb-e05b0f630025 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.013625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d4e4-f15d-48dc-bbbb-e05b0f630025 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.015637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6d4e4-f15d-48dc-bbbb-e05b0f630025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:27.016679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04a49-4ed4-4243-923d-dabf8c4e3483 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:27.018652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6d4e4-f15d-48dc-bbbb-e05b0f630025 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.044906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04a49-4ed4-4243-923d-dabf8c4e3483 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:27.055585 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 927/1874] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:26 2021] GET /identity/v3/roles => generated 1420 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:27.057899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d4e4-f15d-48dc-bbbb-e05b0f630025 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:27.058603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b3f6-0be1-4a53-b00b-8a6e66dd3e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:27.059796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b3f6-0be1-4a53-b00b-8a6e66dd3e36 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.059994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b3f6-0be1-4a53-b00b-8a6e66dd3e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.060260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b3f6-0be1-4a53-b00b-8a6e66dd3e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.061063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161b3f6-0be1-4a53-b00b-8a6e66dd3e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:27.063014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161b3f6-0be1-4a53-b00b-8a6e66dd3e36 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.075687 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 948/1875] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:27.076098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d4e4-f15d-48dc-bbbb-e05b0f630025 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:27.080433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b3f6-0be1-4a53-b00b-8a6e66dd3e36 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:27.083770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ad077-56a2-4b03-b245-ca13f5d4b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:27.085263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ad077-56a2-4b03-b245-ca13f5d4b205 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.085776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ad077-56a2-4b03-b245-ca13f5d4b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.086296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ad077-56a2-4b03-b245-ca13f5d4b205 admin admin] PATH_INFO: `/v3/projects/371ee3d385e0484db19eb9102133598c/users/670bde456aae4c1fbc52123d7c9951d5/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.090751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ad077-56a2-4b03-b245-ca13f5d4b205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371ee3d385e0484db19eb9102133598c, user_id=670bde456aae4c1fbc52123d7c9951d5, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:27.093797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b3f6-0be1-4a53-b00b-8a6e66dd3e36 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:27.096845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ad077-56a2-4b03-b245-ca13f5d4b205 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.100918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:27.102088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.102662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.103448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] PATH_INFO: `/v3/projects/f5196a7aa8a640d1bc5b880b5764f2e9/users/bccdcaf90b184ba3baecb8bd9e1e4181/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.120176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 928/1876] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:27 2021] PUT /identity/v3/projects/371ee3d385e0484db19eb9102133598c/users/670bde456aae4c1fbc52123d7c9951d5/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:27.134229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5196a7aa8a640d1bc5b880b5764f2e9, user_id=bccdcaf90b184ba3baecb8bd9e1e4181, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:27.139652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.165826 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 949/1877] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:27 2021] PUT /identity/v3/projects/f5196a7aa8a640d1bc5b880b5764f2e9/users/bccdcaf90b184ba3baecb8bd9e1e4181/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:27.183887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220bc35-d9d8-4d02-991f-3bec0cd7517c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.184184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220bc35-d9d8-4d02-991f-3bec0cd7517c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.184488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220bc35-d9d8-4d02-991f-3bec0cd7517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.240440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8220bc35-d9d8-4d02-991f-3bec0cd7517c None None] MFA Rules not processed for user `bccdcaf90b184ba3baecb8bd9e1e4181`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:27.242443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8220bc35-d9d8-4d02-991f-3bec0cd7517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:27.322894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:27.326747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:27.373652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 929/1878] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:27 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:27.374888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220bc35-d9d8-4d02-991f-3bec0cd7517c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:27.502953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220bc35-d9d8-4d02-991f-3bec0cd7517c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:27.510235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd8ca-2d50-4544-9094-e47cca3b51b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:27.511122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd8ca-2d50-4544-9094-e47cca3b51b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.511844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd8ca-2d50-4544-9094-e47cca3b51b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.512279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd8ca-2d50-4544-9094-e47cca3b51b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.513190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cd8ca-2d50-4544-9094-e47cca3b51b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:27.516324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cd8ca-2d50-4544-9094-e47cca3b51b2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.524320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb949a46-5313-4d5f-a0c4-d2cb752786be admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:27.551202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:27.552352 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.552836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.553135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] PATH_INFO: `/v3/projects/baf9d62c9a9c4d34ac07caec1ee20a2e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.554464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf9d62c9a9c4d34ac07caec1ee20a2e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:27.557274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.591188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 930/1879] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:27 2021] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:27.592902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd8ca-2d50-4544-9094-e47cca3b51b2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:27.666132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf9d62c9a9c4d34ac07caec1ee20a2e', 'request_id': 'req-286d7fbb-8007-40d3-a05c-2f8355b86183'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:27.682939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf9d62c9a9c4d34ac07caec1ee20a2e', 'request_id': 'req-286d7fbb-8007-40d3-a05c-2f8355b86183'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:27.700517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf9d62c9a9c4d34ac07caec1ee20a2e', 'request_id': 'req-286d7fbb-8007-40d3-a05c-2f8355b86183'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:27.745270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] The token cache is being invalidate because project baf9d62c9a9c4d34ac07caec1ee20a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:27.745997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:27.746392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:27.751218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 950/1880] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:27 2021] DELETE /identity/v3/projects/baf9d62c9a9c4d34ac07caec1ee20a2e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:27.752348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:27.755807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:27.758271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd8ca-2d50-4544-9094-e47cca3b51b2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:27.917738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:27.918387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.918861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.919150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.919868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:27.922083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.944810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7fbb-8007-40d3-a05c-2f8355b86183 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:27.957712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:27.958830 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:27.959191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:27.959530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] PATH_INFO: `/v3/users/8439f03861614f5ab3bd8402d05982cb` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:27.961153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8439f03861614f5ab3bd8402d05982cb)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:27.968970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:27.994730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 931/1881] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:27 2021] POST /identity/v3/users => generated 297 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:28.000128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:28.002085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:28.034154 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6de726-6804-4f9b-99b0-dfae7359e5e5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:28.040927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee58a9-d01d-45f3-95d0-4c1cc4063a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:28.042604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee58a9-d01d-45f3-95d0-4c1cc4063a5b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:28.042967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee58a9-d01d-45f3-95d0-4c1cc4063a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:28.043807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee58a9-d01d-45f3-95d0-4c1cc4063a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:28.044651 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee58a9-d01d-45f3-95d0-4c1cc4063a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:28.047345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee58a9-d01d-45f3-95d0-4c1cc4063a5b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:28.066390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 932/1882] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:28.073176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee58a9-d01d-45f3-95d0-4c1cc4063a5b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:28.104207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee58a9-d01d-45f3-95d0-4c1cc4063a5b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:28.123404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:28.124392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:28.125891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:28.127951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] PATH_INFO: `/v3/projects/60d1109ca22e41a69cde118009687e86/users/1a80ec81afc14c8bb41b0d91c79f84bc/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:28.180323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8439f03861614f5ab3bd8402d05982cb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:28.185127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d1109ca22e41a69cde118009687e86, user_id=1a80ec81afc14c8bb41b0d91c79f84bc, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:28.191660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:28.197107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8439f03861614f5ab3bd8402d05982cb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:28.208899 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8439f03861614f5ab3bd8402d05982cb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:28.211010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8439f03861614f5ab3bd8402d05982cb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:28.227265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 933/1883] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:28 2021] PUT /identity/v3/projects/60d1109ca22e41a69cde118009687e86/users/1a80ec81afc14c8bb41b0d91c79f84bc/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:28.233027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:28.235579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:28.239476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8439f03861614f5ab3bd8402d05982cb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:28.255739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 951/1884] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:27 2021] DELETE /identity/v3/users/8439f03861614f5ab3bd8402d05982cb => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:28.351047 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d93a00-7d55-4f2a-9d6c-bf117730e74a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:28.440738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d5fc-6243-46c3-acea-e0333c6bafc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:28.442019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d5fc-6243-46c3-acea-e0333c6bafc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:28.442715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d5fc-6243-46c3-acea-e0333c6bafc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:28.443982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d5fc-6243-46c3-acea-e0333c6bafc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:28.445769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72d5fc-6243-46c3-acea-e0333c6bafc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:28.449606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72d5fc-6243-46c3-acea-e0333c6bafc2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:28.478091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 934/1885] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:28 2021] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:28.482275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:28.506997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bcaf-0cfb-4c48-8950-f982f2fc6123 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:28.523458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:28.526443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:28.527303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:28.528058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] PATH_INFO: `/v3/projects/60d1109ca22e41a69cde118009687e86/users/1a80ec81afc14c8bb41b0d91c79f84bc/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:28.533410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d1109ca22e41a69cde118009687e86, user_id=1a80ec81afc14c8bb41b0d91c79f84bc, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:28.541551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:28.572659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 952/1886] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:28 2021] PUT /identity/v3/projects/60d1109ca22e41a69cde118009687e86/users/1a80ec81afc14c8bb41b0d91c79f84bc/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:28.583653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0579f-2be4-4e04-8d0b-a81c82e77b10 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:28.584452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0579f-2be4-4e04-8d0b-a81c82e77b10 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:28.584758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0579f-2be4-4e04-8d0b-a81c82e77b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:28.675671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-86d0579f-2be4-4e04-8d0b-a81c82e77b10 None None] MFA Rules not processed for user `1a80ec81afc14c8bb41b0d91c79f84bc`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:28.678682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-86d0579f-2be4-4e04-8d0b-a81c82e77b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:28.826195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 935/1887] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:28 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:28.857405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:28.860691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:28.965671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e525a-d880-4dff-b3d8-fd1b286b723b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:28.966002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e525a-d880-4dff-b3d8-fd1b286b723b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:28.966290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e525a-d880-4dff-b3d8-fd1b286b723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.034965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8c7e525a-d880-4dff-b3d8-fd1b286b723b None None] MFA Rules not processed for user `670bde456aae4c1fbc52123d7c9951d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:29.036340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8c7e525a-d880-4dff-b3d8-fd1b286b723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:29.053616 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da2100-98e1-4134-b517-e3cc5106163f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:29.062849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150df4-b502-4a83-91f6-d43b39e11901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:29.064280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150df4-b502-4a83-91f6-d43b39e11901 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:29.065017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150df4-b502-4a83-91f6-d43b39e11901 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:29.066392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150df4-b502-4a83-91f6-d43b39e11901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.087956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f150df4-b502-4a83-91f6-d43b39e11901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:29.091194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f150df4-b502-4a83-91f6-d43b39e11901 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:29.112790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 953/1888] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:28 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:29.146522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 936/1889] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:28 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:29.162476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150df4-b502-4a83-91f6-d43b39e11901 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:29.183263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150df4-b502-4a83-91f6-d43b39e11901 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:29.188940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:29.190069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:29.190765 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:29.191266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.195081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:29.211835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e525a-d880-4dff-b3d8-fd1b286b723b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:29.213640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8c7e525a-d880-4dff-b3d8-fd1b286b723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:29.293612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:29.295694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:29.310367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 954/1890] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:29 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:29.311637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:29.313808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:29.325637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e525a-d880-4dff-b3d8-fd1b286b723b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:29.328240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e71a-164b-46cc-a757-00a9f59da501 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:29.332083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190461b-3001-450a-bffa-ce27e33bc80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:29.332756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190461b-3001-450a-bffa-ce27e33bc80e service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:29.333104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190461b-3001-450a-bffa-ce27e33bc80e service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:29.333425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190461b-3001-450a-bffa-ce27e33bc80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.335388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c190461b-3001-450a-bffa-ce27e33bc80e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:29.339223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:29.340051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:29.340418 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:29.340773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] PATH_INFO: `/v3/projects/f6e06c1c827b407eb2e4bf65cd722d20` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.343789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e06c1c827b407eb2e4bf65cd722d20)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:29.347025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:29.439466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190461b-3001-450a-bffa-ce27e33bc80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:29.441358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190461b-3001-450a-bffa-ce27e33bc80e service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:29.451756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 955/1891] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:29 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:29.460820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e06c1c827b407eb2e4bf65cd722d20', 'request_id': 'req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:29.476349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e06c1c827b407eb2e4bf65cd722d20', 'request_id': 'req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:29.494656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e06c1c827b407eb2e4bf65cd722d20', 'request_id': 'req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:29.531246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] The token cache is being invalidate because project f6e06c1c827b407eb2e4bf65cd722d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:29.534145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:29.534992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c1abd3b-9de4-4d3f-8f8f-17b3077d2117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:29.542570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 937/1892] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:29 2021] DELETE /identity/v3/projects/f6e06c1c827b407eb2e4bf65cd722d20 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:29.543936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fc42-c2e1-41ae-8ac3-a98ad7273b11 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:29.544329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fc42-c2e1-41ae-8ac3-a98ad7273b11 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:29.544953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fc42-c2e1-41ae-8ac3-a98ad7273b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.575362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-48a7fc42-c2e1-41ae-8ac3-a98ad7273b11 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:29.576652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-48a7fc42-c2e1-41ae-8ac3-a98ad7273b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:29.662669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 956/1893] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:29.672344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc97e-52bd-4e5c-8219-3ac9907a7c43 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:29.673155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc97e-52bd-4e5c-8219-3ac9907a7c43 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:29.673155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc97e-52bd-4e5c-8219-3ac9907a7c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.702510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ce0cc97e-52bd-4e5c-8219-3ac9907a7c43 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:29.703761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ce0cc97e-52bd-4e5c-8219-3ac9907a7c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:29.717037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 938/1894] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:29.722277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7fc42-c2e1-41ae-8ac3-a98ad7273b11 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:29.737810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7fc42-c2e1-41ae-8ac3-a98ad7273b11 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:29.745477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:29.747008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:29.747581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:29.748191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.750094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:29.750541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:29.752542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:29.776904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 957/1895] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:58:29.784101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cc97e-52bd-4e5c-8219-3ac9907a7c43 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:29.803275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cc97e-52bd-4e5c-8219-3ac9907a7c43 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:29.823123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5e703-c2e4-4b1f-adcd-42d0c97c7de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:29.826371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5e703-c2e4-4b1f-adcd-42d0c97c7de9 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:29.829633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5e703-c2e4-4b1f-adcd-42d0c97c7de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:29.831419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5e703-c2e4-4b1f-adcd-42d0c97c7de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:29.833193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5e703-c2e4-4b1f-adcd-42d0c97c7de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:29.847393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5e703-c2e4-4b1f-adcd-42d0c97c7de9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:29.918878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 939/1896] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:29 2021] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:29.923562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:29.936408 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc32b7a-da8b-4254-9d3a-5379a2f7eab6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:30.074765 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e0e15-2d87-4361-a111-1e89903bf672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:30.075947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e0e15-2d87-4361-a111-1e89903bf672 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:30.076577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e0e15-2d87-4361-a111-1e89903bf672 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:30.077026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e0e15-2d87-4361-a111-1e89903bf672 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:30.078208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e0e15-2d87-4361-a111-1e89903bf672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:30.082448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e0e15-2d87-4361-a111-1e89903bf672 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:30.123309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 958/1897] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:29 2021] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:30.126356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5e703-c2e4-4b1f-adcd-42d0c97c7de9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:30.151726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5e703-c2e4-4b1f-adcd-42d0c97c7de9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:30.158901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29a66-8a4a-4037-bff3-3be3ec660609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:30.160336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29a66-8a4a-4037-bff3-3be3ec660609 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:30.160723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29a66-8a4a-4037-bff3-3be3ec660609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:30.161175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29a66-8a4a-4037-bff3-3be3ec660609 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:30.162047 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c29a66-8a4a-4037-bff3-3be3ec660609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:30.164442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c29a66-8a4a-4037-bff3-3be3ec660609 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:30.183154 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 940/1898] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:30 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:30.188331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e0e15-2d87-4361-a111-1e89903bf672 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:30.201347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e0e15-2d87-4361-a111-1e89903bf672 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:30.207287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15f5f-8d86-4c27-8864-44346b9c6372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:30.208154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15f5f-8d86-4c27-8864-44346b9c6372 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:30.208594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15f5f-8d86-4c27-8864-44346b9c6372 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:30.209099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15f5f-8d86-4c27-8864-44346b9c6372 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:30.210174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d15f5f-8d86-4c27-8864-44346b9c6372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:30.213342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d15f5f-8d86-4c27-8864-44346b9c6372 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:30.227263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 959/1899] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:58:30.234144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29a66-8a4a-4037-bff3-3be3ec660609 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:30.245466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29a66-8a4a-4037-bff3-3be3ec660609 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:30.251425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fa051-ff76-4404-9908-7a577f7934c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:30.252276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fa051-ff76-4404-9908-7a577f7934c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:30.252647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fa051-ff76-4404-9908-7a577f7934c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:30.252828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fa051-ff76-4404-9908-7a577f7934c2 admin admin] PATH_INFO: `/v3/projects/cbea23a9018e40d3a0059ce0ee8aefa6/users/65bdd50e734348888506665c34ff9672/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:30.276806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fa051-ff76-4404-9908-7a577f7934c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbea23a9018e40d3a0059ce0ee8aefa6, user_id=65bdd50e734348888506665c34ff9672, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:30.279884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fa051-ff76-4404-9908-7a577f7934c2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:30.299057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 941/1900] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:30 2021] PUT /identity/v3/projects/cbea23a9018e40d3a0059ce0ee8aefa6/users/65bdd50e734348888506665c34ff9672/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:30.320064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00044a-8974-4274-9b49-c0fb7d7c14cd None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:30.320346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00044a-8974-4274-9b49-c0fb7d7c14cd None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:30.320700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00044a-8974-4274-9b49-c0fb7d7c14cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:30.363743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-cb00044a-8974-4274-9b49-c0fb7d7c14cd None None] MFA Rules not processed for user `65bdd50e734348888506665c34ff9672`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:30.365537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-cb00044a-8974-4274-9b49-c0fb7d7c14cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:30.492747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 960/1901] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:30 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:30.498817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fa051-ff76-4404-9908-7a577f7934c2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:30.612133 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fa051-ff76-4404-9908-7a577f7934c2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:30.622702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387d7b-31bc-4efc-8105-eeb4e530931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:30.623413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387d7b-31bc-4efc-8105-eeb4e530931a admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:30.623784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387d7b-31bc-4efc-8105-eeb4e530931a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:30.624125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387d7b-31bc-4efc-8105-eeb4e530931a admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:30.624857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f387d7b-31bc-4efc-8105-eeb4e530931a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:30.627269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f387d7b-31bc-4efc-8105-eeb4e530931a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:30.666943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 942/1902] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:30 2021] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:30.671779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00044a-8974-4274-9b49-c0fb7d7c14cd None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:30.687472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00044a-8974-4274-9b49-c0fb7d7c14cd None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:30.859638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6219-263d-4bc8-8b81-8abfb10910d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:30.860334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6219-263d-4bc8-8b81-8abfb10910d6 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:30.863221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6219-263d-4bc8-8b81-8abfb10910d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:30.863546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6219-263d-4bc8-8b81-8abfb10910d6 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:30.866935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6219-263d-4bc8-8b81-8abfb10910d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:30.874703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6219-263d-4bc8-8b81-8abfb10910d6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:30.908929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 961/1903] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:30 2021] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:30.914895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387d7b-31bc-4efc-8105-eeb4e530931a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:30.950020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387d7b-31bc-4efc-8105-eeb4e530931a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:30.981847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7ff2-45c4-41bb-9b20-e86f245a294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:30.983872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7ff2-45c4-41bb-9b20-e86f245a294f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:30.994436 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7ff2-45c4-41bb-9b20-e86f245a294f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:31.002559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7ff2-45c4-41bb-9b20-e86f245a294f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:31.005142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7ff2-45c4-41bb-9b20-e86f245a294f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:31.019971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7ff2-45c4-41bb-9b20-e86f245a294f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:31.088687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 943/1904] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:30 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:31.094639 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6219-263d-4bc8-8b81-8abfb10910d6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:31.119432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6219-263d-4bc8-8b81-8abfb10910d6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:31.128490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f7f1d-f1b7-4386-90d1-f955b8ef74c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:31.131511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7f1d-f1b7-4386-90d1-f955b8ef74c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:31.132994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7f1d-f1b7-4386-90d1-f955b8ef74c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:31.133303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7f1d-f1b7-4386-90d1-f955b8ef74c3 admin admin] PATH_INFO: `/v3/projects/35d686e0a77243f99a87c908661f55b6/users/6acb0e83837642b4a286a4a3fdc8e70f/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:31.217153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f7f1d-f1b7-4386-90d1-f955b8ef74c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d686e0a77243f99a87c908661f55b6, user_id=6acb0e83837642b4a286a4a3fdc8e70f, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:31.229043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f7f1d-f1b7-4386-90d1-f955b8ef74c3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:31.306519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 962/1905] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:31 2021] PUT /identity/v3/projects/35d686e0a77243f99a87c908661f55b6/users/6acb0e83837642b4a286a4a3fdc8e70f/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:31.313559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7ff2-45c4-41bb-9b20-e86f245a294f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:31.354346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7ff2-45c4-41bb-9b20-e86f245a294f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:31.557580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cf4d9-9f11-40ad-8aef-ffed813c4f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:31.558192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf4d9-9f11-40ad-8aef-ffed813c4f47 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:31.558510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf4d9-9f11-40ad-8aef-ffed813c4f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:31.558794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf4d9-9f11-40ad-8aef-ffed813c4f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:31.559496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cf4d9-9f11-40ad-8aef-ffed813c4f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:31.561099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cf4d9-9f11-40ad-8aef-ffed813c4f47 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:31.576198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 944/1906] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:31 2021] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:31.583022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f7f1d-f1b7-4386-90d1-f955b8ef74c3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:31.606166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f7f1d-f1b7-4386-90d1-f955b8ef74c3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:31.615130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:31.616819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:31.617276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:31.617794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] PATH_INFO: `/v3/projects/35d686e0a77243f99a87c908661f55b6/users/6acb0e83837642b4a286a4a3fdc8e70f/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:31.622048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d686e0a77243f99a87c908661f55b6, user_id=6acb0e83837642b4a286a4a3fdc8e70f, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:31.639166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:31.657716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 963/1907] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:31 2021] PUT /identity/v3/projects/35d686e0a77243f99a87c908661f55b6/users/6acb0e83837642b4a286a4a3fdc8e70f/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:31.668999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac7ae-22dd-431e-8125-ddc1b67995bb None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:31.669341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac7ae-22dd-431e-8125-ddc1b67995bb None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:31.669560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac7ae-22dd-431e-8125-ddc1b67995bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:31.710727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-527ac7ae-22dd-431e-8125-ddc1b67995bb None None] MFA Rules not processed for user `6acb0e83837642b4a286a4a3fdc8e70f`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:31.711942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-527ac7ae-22dd-431e-8125-ddc1b67995bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:31.714591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:31.716696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:31.810788 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd4e38-628f-4768-8db5-d879f8d7e311 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:31.816815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:31.818161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:31.818912 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:31.819632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:31.823353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:31.836845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 945/1908] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:31 2021] POST /identity/v3/auth/tokens => generated 3767 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:31.847590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac7ae-22dd-431e-8125-ddc1b67995bb None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:31.848930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-527ac7ae-22dd-431e-8125-ddc1b67995bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:31.865879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac7ae-22dd-431e-8125-ddc1b67995bb None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:31.871897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bad5f-8dcc-424d-a806-2c0f43f34104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:31.872852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bad5f-8dcc-424d-a806-2c0f43f34104 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:31.873316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bad5f-8dcc-424d-a806-2c0f43f34104 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:31.873780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bad5f-8dcc-424d-a806-2c0f43f34104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:31.889921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bad5f-8dcc-424d-a806-2c0f43f34104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:31.892368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bad5f-8dcc-424d-a806-2c0f43f34104 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:31.910082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 946/1909] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:31 2021] GET /identity/v3/auth/tokens => generated 3767 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:31.959743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:31.962440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:31.980086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 964/1910] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:31 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:32.003570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bad5f-8dcc-424d-a806-2c0f43f34104 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:32.022017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bad5f-8dcc-424d-a806-2c0f43f34104 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:32.027717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed432147-993a-4333-9f0a-f9f3ecbbf6ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:32.028315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed432147-993a-4333-9f0a-f9f3ecbbf6ca service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:32.028604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed432147-993a-4333-9f0a-f9f3ecbbf6ca service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:32.028896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed432147-993a-4333-9f0a-f9f3ecbbf6ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:32.123598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed432147-993a-4333-9f0a-f9f3ecbbf6ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:32.125702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed432147-993a-4333-9f0a-f9f3ecbbf6ca service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:32.140067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 947/1911] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:32 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:34.656661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:34.659862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:34.946893 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956cc5-0d67-475a-aa09-98f9841ddfb4 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:34.962365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:34.967346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:34.967638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:34.967962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] PATH_INFO: `/v3/users/bccdcaf90b184ba3baecb8bd9e1e4181` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:34.974979 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bccdcaf90b184ba3baecb8bd9e1e4181)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:34.979398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:35.142086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bccdcaf90b184ba3baecb8bd9e1e4181'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:35.155349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bccdcaf90b184ba3baecb8bd9e1e4181'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:35.158282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bccdcaf90b184ba3baecb8bd9e1e4181'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:35.159874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bccdcaf90b184ba3baecb8bd9e1e4181'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:35.192297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bccdcaf90b184ba3baecb8bd9e1e4181'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:35.231304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 965/1912] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:34 2021] DELETE /identity/v3/users/bccdcaf90b184ba3baecb8bd9e1e4181 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:35.236348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eecdf-db52-44eb-9f86-c3ecd4bf210a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:35.237213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eecdf-db52-44eb-9f86-c3ecd4bf210a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:35.237382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eecdf-db52-44eb-9f86-c3ecd4bf210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:35.271520 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4d4eecdf-db52-44eb-9f86-c3ecd4bf210a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:35.273441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4d4eecdf-db52-44eb-9f86-c3ecd4bf210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:35.423625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 948/1913] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:35.435420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:35.437037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:35.581996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80068f0-be47-407a-a162-7588838bdf81 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:35.586972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161943af-aef1-466e-b580-ca40801ccfda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:35.587769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161943af-aef1-466e-b580-ca40801ccfda service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:35.588109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161943af-aef1-466e-b580-ca40801ccfda service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:35.588396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161943af-aef1-466e-b580-ca40801ccfda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:35.609258 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161943af-aef1-466e-b580-ca40801ccfda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:35.612528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161943af-aef1-466e-b580-ca40801ccfda service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:35.646968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 966/1914] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:36.253957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4eecdf-db52-44eb-9f86-c3ecd4bf210a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:36.256012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4d4eecdf-db52-44eb-9f86-c3ecd4bf210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:36.268289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4eecdf-db52-44eb-9f86-c3ecd4bf210a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:36.273537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:36.275387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:36.275838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:36.276313 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] PATH_INFO: `/v3/projects/f5196a7aa8a640d1bc5b880b5764f2e9` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:36.277751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5196a7aa8a640d1bc5b880b5764f2e9)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:36.279939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:36.360090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5196a7aa8a640d1bc5b880b5764f2e9', 'request_id': 'req-9c5afe36-0b8d-4960-835b-9e4879fc839a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.371056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5196a7aa8a640d1bc5b880b5764f2e9', 'request_id': 'req-9c5afe36-0b8d-4960-835b-9e4879fc839a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.388371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5196a7aa8a640d1bc5b880b5764f2e9', 'request_id': 'req-9c5afe36-0b8d-4960-835b-9e4879fc839a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.410780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] The token cache is being invalidate because project f5196a7aa8a640d1bc5b880b5764f2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:36.411308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.412212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.414385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 949/1915] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:36 2021] DELETE /identity/v3/projects/f5196a7aa8a640d1bc5b880b5764f2e9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:36.421741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161943af-aef1-466e-b580-ca40801ccfda service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:36.436964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161943af-aef1-466e-b580-ca40801ccfda service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:36.513135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:36.514226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:36.514559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:36.514837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] PATH_INFO: `/v3/users/1a80ec81afc14c8bb41b0d91c79f84bc` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:36.527136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a80ec81afc14c8bb41b0d91c79f84bc)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:36.527136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:36.574431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a80ec81afc14c8bb41b0d91c79f84bc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.585580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a80ec81afc14c8bb41b0d91c79f84bc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.586785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a80ec81afc14c8bb41b0d91c79f84bc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.588101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a80ec81afc14c8bb41b0d91c79f84bc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.606898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6dd9b89d-4fb8-4f99-a09e-aba65cf3fb88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a80ec81afc14c8bb41b0d91c79f84bc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:36.621848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 967/1916] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:36 2021] DELETE /identity/v3/users/1a80ec81afc14c8bb41b0d91c79f84bc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:37.205636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:37.207509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:37.228605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5afe36-0b8d-4960-835b-9e4879fc839a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:37.342056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:37.343232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:37.343614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:37.343982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] PATH_INFO: `/v3/projects/60d1109ca22e41a69cde118009687e86` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:37.345988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d1109ca22e41a69cde118009687e86)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:37.349404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:37.439367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d1109ca22e41a69cde118009687e86', 'request_id': 'req-e0d39005-ec9c-4c02-81cf-4a58bba42f87'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:37.448384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d1109ca22e41a69cde118009687e86', 'request_id': 'req-e0d39005-ec9c-4c02-81cf-4a58bba42f87'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:37.460762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d1109ca22e41a69cde118009687e86', 'request_id': 'req-e0d39005-ec9c-4c02-81cf-4a58bba42f87'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:37.484698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] The token cache is being invalidate because project 60d1109ca22e41a69cde118009687e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:37.485155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:37.485961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e0d39005-ec9c-4c02-81cf-4a58bba42f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:37.488545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 950/1917] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:37 2021] DELETE /identity/v3/projects/60d1109ca22e41a69cde118009687e86 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:37.497234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf07ae-e157-4974-8637-98113775f9d2 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:37.498075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf07ae-e157-4974-8637-98113775f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:37.498075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf07ae-e157-4974-8637-98113775f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:37.528054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-8aaf07ae-e157-4974-8637-98113775f9d2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:37.529480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8aaf07ae-e157-4974-8637-98113775f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:37.649396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 968/1918] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:37.659932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7dc96-dbe6-449f-96d2-e52e2cf07500 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:37.660404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7dc96-dbe6-449f-96d2-e52e2cf07500 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:37.660907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7dc96-dbe6-449f-96d2-e52e2cf07500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:37.699270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d2d7dc96-dbe6-449f-96d2-e52e2cf07500 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:37.701028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d2d7dc96-dbe6-449f-96d2-e52e2cf07500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:37.713139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 951/1919] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:37.719321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf07ae-e157-4974-8637-98113775f9d2 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:37.730741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf07ae-e157-4974-8637-98113775f9d2 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:37.736246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:37.737038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:37.737469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:37.738077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:37.739016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:37.739554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:37.741832 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:37.761222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 969/1920] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:37.767015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7dc96-dbe6-449f-96d2-e52e2cf07500 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:37.778748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7dc96-dbe6-449f-96d2-e52e2cf07500 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:37.784232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64579b-bcbb-4c00-b4a4-941021db2450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:37.785280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64579b-bcbb-4c00-b4a4-941021db2450 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:37.785819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64579b-bcbb-4c00-b4a4-941021db2450 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:37.786367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64579b-bcbb-4c00-b4a4-941021db2450 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:37.787463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64579b-bcbb-4c00-b4a4-941021db2450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:37.790010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64579b-bcbb-4c00-b4a4-941021db2450 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:37.835753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 952/1921] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:37 2021] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:37.842954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:37.862335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447685c8-efe9-4778-bd04-a3d8412df0ef admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:37.982027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c53dd-2355-471b-a79d-6a68b126249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:37.982934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c53dd-2355-471b-a79d-6a68b126249f admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:37.983223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c53dd-2355-471b-a79d-6a68b126249f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:37.983502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c53dd-2355-471b-a79d-6a68b126249f admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:37.984152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c53dd-2355-471b-a79d-6a68b126249f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:37.986128 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c53dd-2355-471b-a79d-6a68b126249f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.014490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 970/1922] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:37 2021] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:38.016079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64579b-bcbb-4c00-b4a4-941021db2450 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:38.026441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64579b-bcbb-4c00-b4a4-941021db2450 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:38.031046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea26cb-be5b-4c5b-b721-43f4d602d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:38.031654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea26cb-be5b-4c5b-b721-43f4d602d512 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.031941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea26cb-be5b-4c5b-b721-43f4d602d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.032218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea26cb-be5b-4c5b-b721-43f4d602d512 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.032920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea26cb-be5b-4c5b-b721-43f4d602d512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:38.034561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea26cb-be5b-4c5b-b721-43f4d602d512 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.048046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 953/1923] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:38.053441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c53dd-2355-471b-a79d-6a68b126249f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:38.066155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c53dd-2355-471b-a79d-6a68b126249f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:38.072456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086b5fd-40d6-45da-98eb-582e53d5024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:38.073249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b5fd-40d6-45da-98eb-582e53d5024a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.073609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b5fd-40d6-45da-98eb-582e53d5024a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.073961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b5fd-40d6-45da-98eb-582e53d5024a admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.074800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086b5fd-40d6-45da-98eb-582e53d5024a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:38.077005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086b5fd-40d6-45da-98eb-582e53d5024a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.089602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 971/1924] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:38.094070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea26cb-be5b-4c5b-b721-43f4d602d512 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:38.104986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea26cb-be5b-4c5b-b721-43f4d602d512 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:38.110292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11ea99-2ce3-4f34-9b1d-7a3d6e6f1bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:38.111424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ea99-2ce3-4f34-9b1d-7a3d6e6f1bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.111857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ea99-2ce3-4f34-9b1d-7a3d6e6f1bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.112195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ea99-2ce3-4f34-9b1d-7a3d6e6f1bb7 admin admin] PATH_INFO: `/v3/projects/e93d9b9df2e94bf19d3746f563a44ead/users/a2dd215d276f4c76a6ff1217bb64e4e9/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.134690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11ea99-2ce3-4f34-9b1d-7a3d6e6f1bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93d9b9df2e94bf19d3746f563a44ead, user_id=a2dd215d276f4c76a6ff1217bb64e4e9, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:38.137368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11ea99-2ce3-4f34-9b1d-7a3d6e6f1bb7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.157354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 954/1925] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:38 2021] PUT /identity/v3/projects/e93d9b9df2e94bf19d3746f563a44ead/users/a2dd215d276f4c76a6ff1217bb64e4e9/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:38.177405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3d13-e985-4501-9eb5-3c5b9edfa9be None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.179013 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3d13-e985-4501-9eb5-3c5b9edfa9be None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.179578 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3d13-e985-4501-9eb5-3c5b9edfa9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.226392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-014c3d13-e985-4501-9eb5-3c5b9edfa9be None None] MFA Rules not processed for user `a2dd215d276f4c76a6ff1217bb64e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:38.228098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-014c3d13-e985-4501-9eb5-3c5b9edfa9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:38.342259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 972/1926] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:38 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:38.351883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11ea99-2ce3-4f34-9b1d-7a3d6e6f1bb7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:38.438075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11ea99-2ce3-4f34-9b1d-7a3d6e6f1bb7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:38.445972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966520d-f321-4e1d-b23e-fb20b0c4e152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:38.449538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966520d-f321-4e1d-b23e-fb20b0c4e152 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.449538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966520d-f321-4e1d-b23e-fb20b0c4e152 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.449538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966520d-f321-4e1d-b23e-fb20b0c4e152 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.449538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966520d-f321-4e1d-b23e-fb20b0c4e152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:38.452335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966520d-f321-4e1d-b23e-fb20b0c4e152 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.489967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 955/1927] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:38 2021] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:38.495263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3d13-e985-4501-9eb5-3c5b9edfa9be None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:38.508033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3d13-e985-4501-9eb5-3c5b9edfa9be None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:38.587586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8263-bdab-48fb-b15a-4db61e5717f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:38.588263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8263-bdab-48fb-b15a-4db61e5717f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.588595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8263-bdab-48fb-b15a-4db61e5717f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.588917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8263-bdab-48fb-b15a-4db61e5717f3 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.589606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8263-bdab-48fb-b15a-4db61e5717f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:38.591638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8263-bdab-48fb-b15a-4db61e5717f3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.614709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 973/1928] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:38 2021] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:38.619003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966520d-f321-4e1d-b23e-fb20b0c4e152 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:38.629391 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966520d-f321-4e1d-b23e-fb20b0c4e152 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:38.634769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfdafc-eb5e-4a75-aa9b-fde6ff68df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:38.635379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfdafc-eb5e-4a75-aa9b-fde6ff68df5b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.635666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfdafc-eb5e-4a75-aa9b-fde6ff68df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.635949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfdafc-eb5e-4a75-aa9b-fde6ff68df5b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.636656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfdafc-eb5e-4a75-aa9b-fde6ff68df5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:38.638281 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfdafc-eb5e-4a75-aa9b-fde6ff68df5b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.650534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 956/1929] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:38.655327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8263-bdab-48fb-b15a-4db61e5717f3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:38.670871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8263-bdab-48fb-b15a-4db61e5717f3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:38.676963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808a163-5414-46ce-b973-996e2dcdb93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:38.677730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808a163-5414-46ce-b973-996e2dcdb93a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.678135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808a163-5414-46ce-b973-996e2dcdb93a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.678536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808a163-5414-46ce-b973-996e2dcdb93a admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.679329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808a163-5414-46ce-b973-996e2dcdb93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:38.681540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808a163-5414-46ce-b973-996e2dcdb93a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.704744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 974/1930] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:38 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:38.706987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfdafc-eb5e-4a75-aa9b-fde6ff68df5b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:38.723701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfdafc-eb5e-4a75-aa9b-fde6ff68df5b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:38.728990 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f1a3-e5b6-4997-9b9f-299540a28486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:38.729821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f1a3-e5b6-4997-9b9f-299540a28486 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.730138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f1a3-e5b6-4997-9b9f-299540a28486 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.730435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f1a3-e5b6-4997-9b9f-299540a28486 admin admin] PATH_INFO: `/v3/projects/1bebbe20519f411183dd9c437943d6e6/users/30a7209d1c73448c9d9c372cf083f84c/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.754840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f1a3-e5b6-4997-9b9f-299540a28486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bebbe20519f411183dd9c437943d6e6, user_id=30a7209d1c73448c9d9c372cf083f84c, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:38.757435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f1a3-e5b6-4997-9b9f-299540a28486 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:38.772797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 957/1931] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:38 2021] PUT /identity/v3/projects/1bebbe20519f411183dd9c437943d6e6/users/30a7209d1c73448c9d9c372cf083f84c/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:38.787758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110df17-3540-4c63-b6c9-53eac7926a58 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:38.788207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110df17-3540-4c63-b6c9-53eac7926a58 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:38.788547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110df17-3540-4c63-b6c9-53eac7926a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:38.833526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a110df17-3540-4c63-b6c9-53eac7926a58 None None] MFA Rules not processed for user `30a7209d1c73448c9d9c372cf083f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:38.835146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a110df17-3540-4c63-b6c9-53eac7926a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:38.933009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 975/1932] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:38 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:38.939946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f1a3-e5b6-4997-9b9f-299540a28486 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:39.033674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f1a3-e5b6-4997-9b9f-299540a28486 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:39.039739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254de5e-bc0f-4d26-a5d2-ce03b5815d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:39.040785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254de5e-bc0f-4d26-a5d2-ce03b5815d45 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:39.041121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254de5e-bc0f-4d26-a5d2-ce03b5815d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:39.042178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254de5e-bc0f-4d26-a5d2-ce03b5815d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:39.043096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254de5e-bc0f-4d26-a5d2-ce03b5815d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:39.046121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254de5e-bc0f-4d26-a5d2-ce03b5815d45 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:39.079019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 958/1933] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:38 2021] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:39.083607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110df17-3540-4c63-b6c9-53eac7926a58 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:39.095507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110df17-3540-4c63-b6c9-53eac7926a58 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:39.168419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623be73-6b63-489d-ac6a-6ebe215b87bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:39.169122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623be73-6b63-489d-ac6a-6ebe215b87bb admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:39.169424 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623be73-6b63-489d-ac6a-6ebe215b87bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:39.169711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623be73-6b63-489d-ac6a-6ebe215b87bb admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:39.170373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623be73-6b63-489d-ac6a-6ebe215b87bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:39.172396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623be73-6b63-489d-ac6a-6ebe215b87bb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:39.194672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 976/1934] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:39 2021] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:39.198766 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254de5e-bc0f-4d26-a5d2-ce03b5815d45 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:39.209316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254de5e-bc0f-4d26-a5d2-ce03b5815d45 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:39.215109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1e46-6ef3-4bb5-ba32-d64766d1fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:39.215719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1e46-6ef3-4bb5-ba32-d64766d1fb1e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:39.216006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1e46-6ef3-4bb5-ba32-d64766d1fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:39.216289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1e46-6ef3-4bb5-ba32-d64766d1fb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:39.217022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f1e46-6ef3-4bb5-ba32-d64766d1fb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:39.218694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f1e46-6ef3-4bb5-ba32-d64766d1fb1e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:39.231425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 959/1935] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:39 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:39.236052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623be73-6b63-489d-ac6a-6ebe215b87bb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:39.246315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623be73-6b63-489d-ac6a-6ebe215b87bb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:39.251084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547041e-209e-4e18-ad44-2b0f095a2d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:39.251914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547041e-209e-4e18-ad44-2b0f095a2d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:39.252199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547041e-209e-4e18-ad44-2b0f095a2d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:39.252481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547041e-209e-4e18-ad44-2b0f095a2d87 admin admin] PATH_INFO: `/v3/projects/c61cb585b63442d79b319d4de6e5a7e5/users/a1e899990e0d4a8cbaac1ae9ba88a513/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:39.275031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547041e-209e-4e18-ad44-2b0f095a2d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61cb585b63442d79b319d4de6e5a7e5, user_id=a1e899990e0d4a8cbaac1ae9ba88a513, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:39.280207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547041e-209e-4e18-ad44-2b0f095a2d87 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:39.300545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 977/1936] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:39 2021] PUT /identity/v3/projects/c61cb585b63442d79b319d4de6e5a7e5/users/a1e899990e0d4a8cbaac1ae9ba88a513/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:39.305369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1e46-6ef3-4bb5-ba32-d64766d1fb1e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:39.317308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1e46-6ef3-4bb5-ba32-d64766d1fb1e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:39.407242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f2192-d1e5-4bf2-abef-b70288cff48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:39.407907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2192-d1e5-4bf2-abef-b70288cff48b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:39.408082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2192-d1e5-4bf2-abef-b70288cff48b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:39.408566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2192-d1e5-4bf2-abef-b70288cff48b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:39.409849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f2192-d1e5-4bf2-abef-b70288cff48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:39.412995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f2192-d1e5-4bf2-abef-b70288cff48b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:39.437148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 960/1937] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:39 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:39.439105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547041e-209e-4e18-ad44-2b0f095a2d87 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:39.458444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547041e-209e-4e18-ad44-2b0f095a2d87 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:39.467300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:39.468793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:39.469286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:39.469741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] PATH_INFO: `/v3/projects/c61cb585b63442d79b319d4de6e5a7e5/users/a1e899990e0d4a8cbaac1ae9ba88a513/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:39.473220 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61cb585b63442d79b319d4de6e5a7e5, user_id=a1e899990e0d4a8cbaac1ae9ba88a513, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:39.478865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:39.498708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 978/1938] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:39 2021] PUT /identity/v3/projects/c61cb585b63442d79b319d4de6e5a7e5/users/a1e899990e0d4a8cbaac1ae9ba88a513/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:39.510564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94366624-6865-4aa5-9ffc-bf4d2ea30d89 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:39.511010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94366624-6865-4aa5-9ffc-bf4d2ea30d89 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:39.511644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94366624-6865-4aa5-9ffc-bf4d2ea30d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:39.565250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-94366624-6865-4aa5-9ffc-bf4d2ea30d89 None None] MFA Rules not processed for user `a1e899990e0d4a8cbaac1ae9ba88a513`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:39.567294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-94366624-6865-4aa5-9ffc-bf4d2ea30d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:39.693105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 961/1939] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:39 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:39.733989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:39.735896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:39.819654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc95be-4a0c-431f-94d2-4792f2a63532 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:39.824940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:39.824940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:39.825462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:39.825462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:39.844901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:39.847663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:39.862883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 979/1940] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:39 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:40.035526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94366624-6865-4aa5-9ffc-bf4d2ea30d89 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:40.049466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94366624-6865-4aa5-9ffc-bf4d2ea30d89 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:40.053268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0509879-713e-4790-aa19-5724bd2abc7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:40.053871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509879-713e-4790-aa19-5724bd2abc7b service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:40.054165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509879-713e-4790-aa19-5724bd2abc7b service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:40.054478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509879-713e-4790-aa19-5724bd2abc7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:40.140396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0509879-713e-4790-aa19-5724bd2abc7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:40.142318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0509879-713e-4790-aa19-5724bd2abc7b service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:40.154489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 962/1941] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:40 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:41.507682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:41.509409 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:41.624626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b0fe8-c93d-45fe-8495-0ad7d8d9689e service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:41.631072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:41.632446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:41.632742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:41.633030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] PATH_INFO: `/v3/users/65bdd50e734348888506665c34ff9672` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:41.635017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65bdd50e734348888506665c34ff9672)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:41.637216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:41.732130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65bdd50e734348888506665c34ff9672'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:41.741549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65bdd50e734348888506665c34ff9672'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:41.743142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65bdd50e734348888506665c34ff9672'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:41.743626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65bdd50e734348888506665c34ff9672'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:41.762294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65bdd50e734348888506665c34ff9672'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:41.783520 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 980/1942] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:41 2021] DELETE /identity/v3/users/65bdd50e734348888506665c34ff9672 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:41.788759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103aeb6-5e9c-4f60-bedf-376ae3c77ad8 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:41.797550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103aeb6-5e9c-4f60-bedf-376ae3c77ad8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:41.798909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103aeb6-5e9c-4f60-bedf-376ae3c77ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:41.828592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7103aeb6-5e9c-4f60-bedf-376ae3c77ad8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:41.829846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7103aeb6-5e9c-4f60-bedf-376ae3c77ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:41.929189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 963/1943] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:41.942427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:41.944070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:42.020812 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42948439-4422-4ca5-b765-7df79031369b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:42.025299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb30d-77c7-44f0-973e-e1a34d7a78f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:42.026109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb30d-77c7-44f0-973e-e1a34d7a78f4 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:42.026714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb30d-77c7-44f0-973e-e1a34d7a78f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:42.027221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb30d-77c7-44f0-973e-e1a34d7a78f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:42.043573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fb30d-77c7-44f0-973e-e1a34d7a78f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:42.046043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fb30d-77c7-44f0-973e-e1a34d7a78f4 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:42.063883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 981/1944] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:43.029683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103aeb6-5e9c-4f60-bedf-376ae3c77ad8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:43.031132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7103aeb6-5e9c-4f60-bedf-376ae3c77ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:43.054584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103aeb6-5e9c-4f60-bedf-376ae3c77ad8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:43.068364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:43.069175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:43.069465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:43.069752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] PATH_INFO: `/v3/projects/cbea23a9018e40d3a0059ce0ee8aefa6` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:43.082163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbea23a9018e40d3a0059ce0ee8aefa6)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:43.085966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:43.155449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbea23a9018e40d3a0059ce0ee8aefa6', 'request_id': 'req-b426f89e-c23f-4d52-a106-07f675f285b8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.167362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbea23a9018e40d3a0059ce0ee8aefa6', 'request_id': 'req-b426f89e-c23f-4d52-a106-07f675f285b8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.180206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbea23a9018e40d3a0059ce0ee8aefa6', 'request_id': 'req-b426f89e-c23f-4d52-a106-07f675f285b8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.202383 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] The token cache is being invalidate because project cbea23a9018e40d3a0059ce0ee8aefa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:43.202715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.203507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.209709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 964/1945] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:43 2021] DELETE /identity/v3/projects/cbea23a9018e40d3a0059ce0ee8aefa6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:43.210868 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb30d-77c7-44f0-973e-e1a34d7a78f4 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:43.222112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb30d-77c7-44f0-973e-e1a34d7a78f4 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:43.310038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:43.311262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:43.312353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:43.313648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] PATH_INFO: `/v3/users/6acb0e83837642b4a286a4a3fdc8e70f` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:43.316317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6acb0e83837642b4a286a4a3fdc8e70f)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:43.327530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:43.426989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6acb0e83837642b4a286a4a3fdc8e70f'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.446262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6acb0e83837642b4a286a4a3fdc8e70f'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.447853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6acb0e83837642b4a286a4a3fdc8e70f'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.449449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6acb0e83837642b4a286a4a3fdc8e70f'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.479814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6acb0e83837642b4a286a4a3fdc8e70f'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:43.532683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 982/1946] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:43 2021] DELETE /identity/v3/users/6acb0e83837642b4a286a4a3fdc8e70f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:44.318687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:44.324434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:44.360696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426f89e-c23f-4d52-a106-07f675f285b8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:44.529116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:44.531111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:44.541701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:44.543214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:44.543522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:44.543804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] PATH_INFO: `/v3/projects/35d686e0a77243f99a87c908661f55b6` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:44.545319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d686e0a77243f99a87c908661f55b6)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:44.558035 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:44.562623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f7960-0f10-40b7-b550-9decc7e32e13 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:44.572532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:44.575635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:44.576269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:44.577034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] PATH_INFO: `/v3/users/a2dd215d276f4c76a6ff1217bb64e4e9` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:44.579417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2dd215d276f4c76a6ff1217bb64e4e9)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:44.583071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:44.662684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d686e0a77243f99a87c908661f55b6', 'request_id': 'req-a6350db5-1aeb-4824-bf86-fab0f2891026'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.669242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d686e0a77243f99a87c908661f55b6', 'request_id': 'req-a6350db5-1aeb-4824-bf86-fab0f2891026'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.672086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2dd215d276f4c76a6ff1217bb64e4e9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.681610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d686e0a77243f99a87c908661f55b6', 'request_id': 'req-a6350db5-1aeb-4824-bf86-fab0f2891026'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.686439 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2dd215d276f4c76a6ff1217bb64e4e9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.687904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2dd215d276f4c76a6ff1217bb64e4e9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.688590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2dd215d276f4c76a6ff1217bb64e4e9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.705291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] The token cache is being invalidate because project 35d686e0a77243f99a87c908661f55b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:44.705627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.706374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a6350db5-1aeb-4824-bf86-fab0f2891026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.708476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 965/1947] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:44 2021] DELETE /identity/v3/projects/35d686e0a77243f99a87c908661f55b6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:44.715383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20fb30d9-b3e0-42ad-a98d-af2485418958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2dd215d276f4c76a6ff1217bb64e4e9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:44.717904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1f2f-2e51-4622-91da-92e6a3d13029 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:44.718169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1f2f-2e51-4622-91da-92e6a3d13029 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:44.718475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1f2f-2e51-4622-91da-92e6a3d13029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:44.744007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 983/1948] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:44 2021] DELETE /identity/v3/users/a2dd215d276f4c76a6ff1217bb64e4e9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:44.747550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7f9d1f2f-2e51-4622-91da-92e6a3d13029 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:44.749239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7f9d1f2f-2e51-4622-91da-92e6a3d13029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:44.751928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399e5b-b69c-41bc-ab18-e58048715d2c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:44.752751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399e5b-b69c-41bc-ab18-e58048715d2c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:44.753215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399e5b-b69c-41bc-ab18-e58048715d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:44.792978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-5c399e5b-b69c-41bc-ab18-e58048715d2c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:44.795402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5c399e5b-b69c-41bc-ab18-e58048715d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:44.869855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 966/1949] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:44.883928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9f5f-cc51-433f-b11c-dae9c5695114 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:44.884789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9f5f-cc51-433f-b11c-dae9c5695114 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:44.885536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9f5f-cc51-433f-b11c-dae9c5695114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:44.944077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 984/1950] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:44.950623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-aa1f9f5f-cc51-433f-b11c-dae9c5695114 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:44.954453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-aa1f9f5f-cc51-433f-b11c-dae9c5695114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:44.963547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399e5b-b69c-41bc-ab18-e58048715d2c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:44.965522 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5c399e5b-b69c-41bc-ab18-e58048715d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:44.978544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 967/1951] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:44.998870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f9f5f-cc51-433f-b11c-dae9c5695114 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:45.020258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f9f5f-cc51-433f-b11c-dae9c5695114 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:45.033836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:45.038288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:45.038288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:45.038288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:45.038288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:45.039308 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:45.044198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:45.076313 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 968/1952] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:58:45.083440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:45.109585 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c0b88-0a1b-4326-8066-6e2fdc930857 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:45.120944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b267-db4d-49f2-816b-712d268368ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:45.122521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b267-db4d-49f2-816b-712d268368ed admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:45.123060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b267-db4d-49f2-816b-712d268368ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:45.128604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b267-db4d-49f2-816b-712d268368ed admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:45.129693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3b267-db4d-49f2-816b-712d268368ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:45.134378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3b267-db4d-49f2-816b-712d268368ed admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:45.142640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399e5b-b69c-41bc-ab18-e58048715d2c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:45.153258 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269b97c-6ab6-4e12-b530-31e1f159bd87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:45.155176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b97c-6ab6-4e12-b530-31e1f159bd87 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:45.155959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b97c-6ab6-4e12-b530-31e1f159bd87 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:45.156730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b97c-6ab6-4e12-b530-31e1f159bd87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:45.182519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269b97c-6ab6-4e12-b530-31e1f159bd87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:45.185755 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269b97c-6ab6-4e12-b530-31e1f159bd87 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:45.205063 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 969/1953] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:45 2021] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:45.210058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 985/1954] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:45.211399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b267-db4d-49f2-816b-712d268368ed admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:45.530602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b267-db4d-49f2-816b-712d268368ed admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:45.549842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40926ed6-5e90-4c4b-8dcb-3c984a0643e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:45.551178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40926ed6-5e90-4c4b-8dcb-3c984a0643e5 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:45.552615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40926ed6-5e90-4c4b-8dcb-3c984a0643e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:45.553045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40926ed6-5e90-4c4b-8dcb-3c984a0643e5 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:45.554959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40926ed6-5e90-4c4b-8dcb-3c984a0643e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:45.559823 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40926ed6-5e90-4c4b-8dcb-3c984a0643e5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:45.644579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 970/1955] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:45 2021] POST /identity/v3/users => generated 283 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:45.646138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269b97c-6ab6-4e12-b530-31e1f159bd87 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:45.677524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269b97c-6ab6-4e12-b530-31e1f159bd87 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:45.712356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be553a6-becc-4d4c-8bbc-9dd9afe36929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:45.718066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be553a6-becc-4d4c-8bbc-9dd9afe36929 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:45.718767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be553a6-becc-4d4c-8bbc-9dd9afe36929 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:45.719281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be553a6-becc-4d4c-8bbc-9dd9afe36929 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:45.721038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be553a6-becc-4d4c-8bbc-9dd9afe36929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:45.730724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be553a6-becc-4d4c-8bbc-9dd9afe36929 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:45.779626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 986/1956] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:45 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:58:45.785375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40926ed6-5e90-4c4b-8dcb-3c984a0643e5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:45.831809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40926ed6-5e90-4c4b-8dcb-3c984a0643e5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:45.859664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d2e48-1ee3-47eb-8f88-37d8f646c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:45.860750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d2e48-1ee3-47eb-8f88-37d8f646c165 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:45.861240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d2e48-1ee3-47eb-8f88-37d8f646c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:45.861743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d2e48-1ee3-47eb-8f88-37d8f646c165 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:45.863071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d2e48-1ee3-47eb-8f88-37d8f646c165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:45.866061 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d2e48-1ee3-47eb-8f88-37d8f646c165 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:45.907700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 971/1957] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:45 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:45.910636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be553a6-becc-4d4c-8bbc-9dd9afe36929 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:45.929694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be553a6-becc-4d4c-8bbc-9dd9afe36929 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:45.952260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:45.953283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:45.953589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:45.953875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] PATH_INFO: `/v3/projects/b9b4ec021316452fb176083144491682/users/9fc5ab30f0d0428dada88a3a1fab0332/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:46.014087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b4ec021316452fb176083144491682, user_id=9fc5ab30f0d0428dada88a3a1fab0332, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:46.017405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:46.040402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 987/1958] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:45 2021] PUT /identity/v3/projects/b9b4ec021316452fb176083144491682/users/9fc5ab30f0d0428dada88a3a1fab0332/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:46.059236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ad8b-bd12-41fd-b8f2-0762a209bf21 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:46.060065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ad8b-bd12-41fd-b8f2-0762a209bf21 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:46.060801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ad8b-bd12-41fd-b8f2-0762a209bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:46.146222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a393ad8b-bd12-41fd-b8f2-0762a209bf21 None None] MFA Rules not processed for user `9fc5ab30f0d0428dada88a3a1fab0332`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:46.149582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a393ad8b-bd12-41fd-b8f2-0762a209bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:46.239466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:46.242033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:46.304962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 972/1959] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:46 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:46.311311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ad8b-bd12-41fd-b8f2-0762a209bf21 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:46.324090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1967b4-b26d-4f33-b470-343c9d273ac3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:46.330354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:46.332111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:46.332632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:46.333160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] PATH_INFO: `/v3/projects/e93d9b9df2e94bf19d3746f563a44ead` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:46.335445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93d9b9df2e94bf19d3746f563a44ead)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:46.337565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ad8b-bd12-41fd-b8f2-0762a209bf21 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:46.340415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:46.342664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d743a-ebf7-49c0-968e-d79290732dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:46.343281 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d743a-ebf7-49c0-968e-d79290732dab admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:46.343573 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d743a-ebf7-49c0-968e-d79290732dab admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:46.343872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d743a-ebf7-49c0-968e-d79290732dab admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:46.344519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d743a-ebf7-49c0-968e-d79290732dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:46.346563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d743a-ebf7-49c0-968e-d79290732dab admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:46.382374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 973/1960] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:46 2021] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:46.383908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d743a-ebf7-49c0-968e-d79290732dab admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:46.429134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93d9b9df2e94bf19d3746f563a44ead', 'request_id': 'req-8356c445-a2d3-451d-acef-834b80a16320'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.435875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93d9b9df2e94bf19d3746f563a44ead', 'request_id': 'req-8356c445-a2d3-451d-acef-834b80a16320'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.447688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93d9b9df2e94bf19d3746f563a44ead', 'request_id': 'req-8356c445-a2d3-451d-acef-834b80a16320'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.468849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] The token cache is being invalidate because project e93d9b9df2e94bf19d3746f563a44ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:46.468849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.469641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.480165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 988/1961] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:46 2021] DELETE /identity/v3/projects/e93d9b9df2e94bf19d3746f563a44ead => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:46.481197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:46.483503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:46.530001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d743a-ebf7-49c0-968e-d79290732dab admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:46.632450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:46.634830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:46.635395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:46.635881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:46.636752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:46.639051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:46.668915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 974/1962] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:46 2021] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:46.670271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:46.672264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:46.673547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c445-a2d3-451d-acef-834b80a16320 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:46.683742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:46.687078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:46.687519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:46.687970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] PATH_INFO: `/v3/users/30a7209d1c73448c9d9c372cf083f84c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:46.688772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa41cd-cb10-4f0c-9f9e-af6482a8a689 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:46.689989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a7209d1c73448c9d9c372cf083f84c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:46.694053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:46.702073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b832e-cd24-4b15-9079-7aea6fda6326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:46.703596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b832e-cd24-4b15-9079-7aea6fda6326 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:46.703939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b832e-cd24-4b15-9079-7aea6fda6326 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:46.707544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b832e-cd24-4b15-9079-7aea6fda6326 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:46.710877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b832e-cd24-4b15-9079-7aea6fda6326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:46.712790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b832e-cd24-4b15-9079-7aea6fda6326 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:46.750660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 975/1963] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:46 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:46.752598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b832e-cd24-4b15-9079-7aea6fda6326 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:46.768624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b832e-cd24-4b15-9079-7aea6fda6326 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:46.776597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde82de-ab2c-4c9b-8206-e5668e43cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:46.777709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde82de-ab2c-4c9b-8206-e5668e43cd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:46.778241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde82de-ab2c-4c9b-8206-e5668e43cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:46.778659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde82de-ab2c-4c9b-8206-e5668e43cd64 admin admin] PATH_INFO: `/v3/projects/535d683b36f34a0198153bb82c44e3c1/users/b7287812566f45ffaf81aae084314bcb/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:46.821613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde82de-ab2c-4c9b-8206-e5668e43cd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535d683b36f34a0198153bb82c44e3c1, user_id=b7287812566f45ffaf81aae084314bcb, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:46.827463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde82de-ab2c-4c9b-8206-e5668e43cd64 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:46.868588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 976/1964] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:46 2021] PUT /identity/v3/projects/535d683b36f34a0198153bb82c44e3c1/users/b7287812566f45ffaf81aae084314bcb/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:46.873900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde82de-ab2c-4c9b-8206-e5668e43cd64 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:46.875060 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a7209d1c73448c9d9c372cf083f84c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.890910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a7209d1c73448c9d9c372cf083f84c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.892475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a7209d1c73448c9d9c372cf083f84c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.893752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a7209d1c73448c9d9c372cf083f84c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.918808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a7209d1c73448c9d9c372cf083f84c'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:46.954743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 989/1965] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:46 2021] DELETE /identity/v3/users/30a7209d1c73448c9d9c372cf083f84c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:46.956552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:46.970807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:47.040435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde82de-ab2c-4c9b-8206-e5668e43cd64 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:47.129098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05790e-0b46-469e-972b-2d341d6b5b29 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:47.144659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:47.148640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:47.151971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:47.152825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] PATH_INFO: `/v3/users/a582e1b955a441538ab6b9a8d2342c1b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:47.159336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a582e1b955a441538ab6b9a8d2342c1b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:47.172821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:47.295903 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:47.297019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:47.297435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:47.297814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:47.303726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:47.310734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:47.366883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 977/1966] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:46 2021] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:47.371414 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:47.379903 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:47.399738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a582e1b955a441538ab6b9a8d2342c1b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:47.426049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a582e1b955a441538ab6b9a8d2342c1b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:47.427523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a582e1b955a441538ab6b9a8d2342c1b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:47.429276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a582e1b955a441538ab6b9a8d2342c1b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:47.440223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99cd7-26af-4bc5-85d2-e26f87e43f70 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:47.462663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fad15-3db9-48d4-ba94-fe2c172c3089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:47.464145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fad15-3db9-48d4-ba94-fe2c172c3089 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:47.464274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-c4108eb8-2163-4962-bfa4-c730b4f42c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a582e1b955a441538ab6b9a8d2342c1b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:47.464651 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fad15-3db9-48d4-ba94-fe2c172c3089 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:47.465148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fad15-3db9-48d4-ba94-fe2c172c3089 admin admin] PATH_INFO: `/v3/projects/535d683b36f34a0198153bb82c44e3c1/users/b7287812566f45ffaf81aae084314bcb/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:47.476098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fad15-3db9-48d4-ba94-fe2c172c3089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535d683b36f34a0198153bb82c44e3c1, user_id=b7287812566f45ffaf81aae084314bcb, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:47.482077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fad15-3db9-48d4-ba94-fe2c172c3089 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:47.499485 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 990/1967] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:46 2021] DELETE /identity/v3/users/a582e1b955a441538ab6b9a8d2342c1b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:47.506909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bbb7-b772-41e4-ac84-0902d813898c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:47.508116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bbb7-b772-41e4-ac84-0902d813898c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:47.508751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bbb7-b772-41e4-ac84-0902d813898c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:47.539942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 978/1968] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:47 2021] PUT /identity/v3/projects/535d683b36f34a0198153bb82c44e3c1/users/b7287812566f45ffaf81aae084314bcb/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:47.551800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69be7-2025-43a9-8f2b-c2a746c30b1b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:47.551996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69be7-2025-43a9-8f2b-c2a746c30b1b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:47.554032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69be7-2025-43a9-8f2b-c2a746c30b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:47.561250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-92c4bbb7-b772-41e4-ac84-0902d813898c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:47.563903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-92c4bbb7-b772-41e4-ac84-0902d813898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:47.647661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e3e69be7-2025-43a9-8f2b-c2a746c30b1b None None] MFA Rules not processed for user `b7287812566f45ffaf81aae084314bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:47.650338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e3e69be7-2025-43a9-8f2b-c2a746c30b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:47.708309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 991/1969] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:47.710273 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4bbb7-b772-41e4-ac84-0902d813898c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:47.712756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-92c4bbb7-b772-41e4-ac84-0902d813898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:47.744979 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4bbb7-b772-41e4-ac84-0902d813898c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:47.767675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:47.768851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:47.769245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:47.769709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] PATH_INFO: `/v3/projects/1bebbe20519f411183dd9c437943d6e6` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:47.771762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bebbe20519f411183dd9c437943d6e6)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:47.795731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:47.846237 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 979/1970] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:47 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:47.848182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e69be7-2025-43a9-8f2b-c2a746c30b1b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:47.850672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e3e69be7-2025-43a9-8f2b-c2a746c30b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:47.953371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bebbe20519f411183dd9c437943d6e6', 'request_id': 'req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:47.959767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bebbe20519f411183dd9c437943d6e6', 'request_id': 'req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:47.969613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bebbe20519f411183dd9c437943d6e6', 'request_id': 'req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:48.010584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e69be7-2025-43a9-8f2b-c2a746c30b1b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:48.024012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] The token cache is being invalidate because project 1bebbe20519f411183dd9c437943d6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:48.024301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:48.025203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:48.027236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 992/1971] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:47 2021] DELETE /identity/v3/projects/1bebbe20519f411183dd9c437943d6e6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:48.030893 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:48.032261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:48.134248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:48.134943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:48.135228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:48.135506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:48.137485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:48.175283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866344f-e373-4ff4-aa4d-ed1ba4c0f59e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:48.179767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:48.181176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:48.181464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:48.181744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:48.183726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:48.321299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:48.323476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:48.331322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:48.335019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:48.350446 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 980/1972] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:48.356294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:48.358614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 993/1973] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:48 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:48.365192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:48.389956 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31312594-5987-49fa-a15e-36fd580b3fbb service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:48.399285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:48.400433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:48.401093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:48.401837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] PATH_INFO: `/v3/users/a1e899990e0d4a8cbaac1ae9ba88a513` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:48.404529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e899990e0d4a8cbaac1ae9ba88a513)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:48.407373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:48.536458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e899990e0d4a8cbaac1ae9ba88a513'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:48.555292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e899990e0d4a8cbaac1ae9ba88a513'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:48.556900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e899990e0d4a8cbaac1ae9ba88a513'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:48.558067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e899990e0d4a8cbaac1ae9ba88a513'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:48.593122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2b3cddf7-0e15-4872-9f69-f4fdfa5295fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e899990e0d4a8cbaac1ae9ba88a513'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:48.666557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 981/1974] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:48 2021] DELETE /identity/v3/users/a1e899990e0d4a8cbaac1ae9ba88a513 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:48.786569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:48.789212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:48.816264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2120-6958-4e9f-bddc-5d6f9f3e9fb0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:48.817264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2120-6958-4e9f-bddc-5d6f9f3e9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:48.817957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2120-6958-4e9f-bddc-5d6f9f3e9fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:48.835707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91809a-4c0c-4619-9d03-bab978bc0e02 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:48.893737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-fd6d2120-6958-4e9f-bddc-5d6f9f3e9fb0 None None] MFA Rules not processed for user `9e0b49f365a542c080e2bdb043dc1387`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:48.895904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fd6d2120-6958-4e9f-bddc-5d6f9f3e9fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:48.940569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:48.941418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:48.941542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:48.941944 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:48.944188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:49.058216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 982/1975] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:48 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:49.082808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:49.091400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:49.122321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 994/1976] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:48 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:49.161966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d2120-6958-4e9f-bddc-5d6f9f3e9fb0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:49.166092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fd6d2120-6958-4e9f-bddc-5d6f9f3e9fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:49.313911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d2120-6958-4e9f-bddc-5d6f9f3e9fb0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:49.328659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:49.329501 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:49.329792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:49.330075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] PATH_INFO: `/v3/projects/8972fc79b7de48839f5212bfcc90b1a6` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:49.333814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8972fc79b7de48839f5212bfcc90b1a6)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:49.335849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:49.460349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8972fc79b7de48839f5212bfcc90b1a6', 'request_id': 'req-c36650d6-fc5e-471f-82a9-3318f8bc2954'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:49.477977 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8972fc79b7de48839f5212bfcc90b1a6', 'request_id': 'req-c36650d6-fc5e-471f-82a9-3318f8bc2954'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:49.498201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8972fc79b7de48839f5212bfcc90b1a6', 'request_id': 'req-c36650d6-fc5e-471f-82a9-3318f8bc2954'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:49.540052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] The token cache is being invalidate because project 8972fc79b7de48839f5212bfcc90b1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:49.544965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:49.549936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:49.554814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 983/1977] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:49 2021] DELETE /identity/v3/projects/8972fc79b7de48839f5212bfcc90b1a6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:49.561796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:49.586815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700c7ff-3a13-41bd-894f-d7837ebe90b9 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:49.690814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:49.692326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:49.795528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:49.799010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:49.799375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:49.799678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] PATH_INFO: `/v3/users/b6059776e305445eb9589f69070d4e1a` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:49.801011 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6059776e305445eb9589f69070d4e1a)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:49.806276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:49.934210 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36650d6-fc5e-471f-82a9-3318f8bc2954 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:49.951423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6059776e305445eb9589f69070d4e1a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:49.955411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:49.955907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:49.956115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:49.956361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] PATH_INFO: `/v3/projects/c61cb585b63442d79b319d4de6e5a7e5` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:49.958892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61cb585b63442d79b319d4de6e5a7e5)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:49.960843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:49.974238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6059776e305445eb9589f69070d4e1a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:49.976024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6059776e305445eb9589f69070d4e1a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:49.978203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6059776e305445eb9589f69070d4e1a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:50.033418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-75119272-9952-4d10-ab2a-97a90111dbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6059776e305445eb9589f69070d4e1a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:50.097632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61cb585b63442d79b319d4de6e5a7e5', 'request_id': 'req-14f5e45d-2da7-4c85-a115-5f6accd93bca'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:50.103337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 995/1978] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:49 2021] DELETE /identity/v3/users/b6059776e305445eb9589f69070d4e1a => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:50.110733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61cb585b63442d79b319d4de6e5a7e5', 'request_id': 'req-14f5e45d-2da7-4c85-a115-5f6accd93bca'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:50.126923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61cb585b63442d79b319d4de6e5a7e5', 'request_id': 'req-14f5e45d-2da7-4c85-a115-5f6accd93bca'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:50.158864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] The token cache is being invalidate because project c61cb585b63442d79b319d4de6e5a7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:50.162649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:50.164942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-14f5e45d-2da7-4c85-a115-5f6accd93bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:50.176985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 984/1979] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:49 2021] DELETE /identity/v3/projects/c61cb585b63442d79b319d4de6e5a7e5 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:50.178808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb644f0-2672-4010-82d4-a154990e2e75 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:50.179107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb644f0-2672-4010-82d4-a154990e2e75 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:50.179393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb644f0-2672-4010-82d4-a154990e2e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:50.303275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-6fb644f0-2672-4010-82d4-a154990e2e75 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:50.305318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6fb644f0-2672-4010-82d4-a154990e2e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:50.453316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 996/1980] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:50.462179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b5b60-155a-47de-aef4-9e239bf0543a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:50.462499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b5b60-155a-47de-aef4-9e239bf0543a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:50.462812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b5b60-155a-47de-aef4-9e239bf0543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:50.491648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-aa6b5b60-155a-47de-aef4-9e239bf0543a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:50.493430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-aa6b5b60-155a-47de-aef4-9e239bf0543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:50.506471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 985/1981] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:50.509458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb644f0-2672-4010-82d4-a154990e2e75 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:50.519997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb644f0-2672-4010-82d4-a154990e2e75 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:50.525507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:50.526133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:50.526444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:50.526736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:50.527551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:50.527851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:50.529793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:50.547481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 997/1982] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:58:50.551998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b5b60-155a-47de-aef4-9e239bf0543a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:50.562704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b5b60-155a-47de-aef4-9e239bf0543a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:50.567933 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504194-f41c-4bef-9f65-b2c274f8899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:50.568701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504194-f41c-4bef-9f65-b2c274f8899a admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:50.569706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504194-f41c-4bef-9f65-b2c274f8899a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:50.570002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504194-f41c-4bef-9f65-b2c274f8899a admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:50.571293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504194-f41c-4bef-9f65-b2c274f8899a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:50.573415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504194-f41c-4bef-9f65-b2c274f8899a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:50.624462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 986/1983] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:50 2021] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:50.631367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:50.643152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c2bc-6e4d-4f81-aadb-60895d341e18 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:50.737177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d110c-45a5-4b03-bf1b-24a098a6ddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:50.738500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d110c-45a5-4b03-bf1b-24a098a6ddba admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:50.739104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d110c-45a5-4b03-bf1b-24a098a6ddba admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:50.740384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d110c-45a5-4b03-bf1b-24a098a6ddba admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:50.741691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d110c-45a5-4b03-bf1b-24a098a6ddba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:50.746734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d110c-45a5-4b03-bf1b-24a098a6ddba admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:50.805821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504194-f41c-4bef-9f65-b2c274f8899a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:50.817253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 998/1984] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:50 2021] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:50.837000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504194-f41c-4bef-9f65-b2c274f8899a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:50.849483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41011dbd-1d44-40c5-8220-79bd8beb737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:50.850987 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41011dbd-1d44-40c5-8220-79bd8beb737e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:50.852716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41011dbd-1d44-40c5-8220-79bd8beb737e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:50.853974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41011dbd-1d44-40c5-8220-79bd8beb737e admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:50.856975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41011dbd-1d44-40c5-8220-79bd8beb737e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:50.861720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41011dbd-1d44-40c5-8220-79bd8beb737e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:50.922058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d110c-45a5-4b03-bf1b-24a098a6ddba admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:50.925610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 987/1985] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:50 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:50.938768 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d110c-45a5-4b03-bf1b-24a098a6ddba admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:50.954087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:50.955084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:50.956286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:50.956710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:50.960599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:50.964213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:51.006457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 999/1986] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:50 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:51.013013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41011dbd-1d44-40c5-8220-79bd8beb737e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:51.037304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41011dbd-1d44-40c5-8220-79bd8beb737e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:51.054807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:51.057243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:51.076940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051838d-9871-49ac-9bad-8403073b3908 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:51.088234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:51.089110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:51.089401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:51.089741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] PATH_INFO: `/v3/projects/d429378b8bd04bbe8f1b8384cfea8c1f` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:51.091020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d429378b8bd04bbe8f1b8384cfea8c1f)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:51.093490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:51.100304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929dc7e-098a-484e-9fd1-67f77b738bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:51.102437 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dc7e-098a-484e-9fd1-67f77b738bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:51.103014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dc7e-098a-484e-9fd1-67f77b738bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:51.103570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dc7e-098a-484e-9fd1-67f77b738bbf admin admin] PATH_INFO: `/v3/projects/2b73f173122a471d8d1203aaabbcd6db/users/df92ae7a27aa4167bc1477fde117ebcb/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:51.146667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929dc7e-098a-484e-9fd1-67f77b738bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b73f173122a471d8d1203aaabbcd6db, user_id=df92ae7a27aa4167bc1477fde117ebcb, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:51.151000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929dc7e-098a-484e-9fd1-67f77b738bbf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:51.183049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 988/1987] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:51 2021] PUT /identity/v3/projects/2b73f173122a471d8d1203aaabbcd6db/users/df92ae7a27aa4167bc1477fde117ebcb/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:51.205499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146fad-b4ed-4dda-bdb6-06149ed53a7f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:51.206014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146fad-b4ed-4dda-bdb6-06149ed53a7f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:51.207183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146fad-b4ed-4dda-bdb6-06149ed53a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:51.224406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd429378b8bd04bbe8f1b8384cfea8c1f', 'request_id': 'req-b6526ff9-3401-49d0-840e-74710b7a22c9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:51.235229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd429378b8bd04bbe8f1b8384cfea8c1f', 'request_id': 'req-b6526ff9-3401-49d0-840e-74710b7a22c9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:51.251144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd429378b8bd04bbe8f1b8384cfea8c1f', 'request_id': 'req-b6526ff9-3401-49d0-840e-74710b7a22c9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:51.280350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] The token cache is being invalidate because project d429378b8bd04bbe8f1b8384cfea8c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:51.280996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:51.282141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b6526ff9-3401-49d0-840e-74710b7a22c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:51.293100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1000/1988] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:51 2021] DELETE /identity/v3/projects/d429378b8bd04bbe8f1b8384cfea8c1f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:51.295793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac0b2-dc63-4351-9955-d97448e211f1 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:51.296388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac0b2-dc63-4351-9955-d97448e211f1 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:51.296986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac0b2-dc63-4351-9955-d97448e211f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:51.298034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-cc146fad-b4ed-4dda-bdb6-06149ed53a7f None None] MFA Rules not processed for user `df92ae7a27aa4167bc1477fde117ebcb`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:51.300325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-cc146fad-b4ed-4dda-bdb6-06149ed53a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:51.330141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-28aac0b2-dc63-4351-9955-d97448e211f1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:51.331646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-28aac0b2-dc63-4351-9955-d97448e211f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:51.416546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 989/1989] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:51 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:51.457075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1001/1990] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:51.459540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb973-c4ef-4b91-8317-225f7bb7c461 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:51.460021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb973-c4ef-4b91-8317-225f7bb7c461 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:51.460569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb973-c4ef-4b91-8317-225f7bb7c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:51.500701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-980cb973-c4ef-4b91-8317-225f7bb7c461 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:51.502848 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-980cb973-c4ef-4b91-8317-225f7bb7c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:51.519454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 990/1991] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:51.532076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aac0b2-dc63-4351-9955-d97448e211f1 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:51.534865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cb973-c4ef-4b91-8317-225f7bb7c461 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:51.539821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-980cb973-c4ef-4b91-8317-225f7bb7c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:51.546864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aac0b2-dc63-4351-9955-d97448e211f1 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:51.563555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:51.564534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:51.565026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:51.565537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:51.566848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:51.567382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:51.584134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:51.610324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1002/1992] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:51.616654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:51.649575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff9277-e4bd-474b-bdba-20858cac43ae admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:51.673096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:51.674311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:51.676060 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:51.677814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:51.682438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:51.687099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cb973-c4ef-4b91-8317-225f7bb7c461 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:51.690422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:51.691839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562257-aef2-4b75-9497-70a1226700da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:51.692861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562257-aef2-4b75-9497-70a1226700da service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:51.693346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562257-aef2-4b75-9497-70a1226700da service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:51.693787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562257-aef2-4b75-9497-70a1226700da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:51.707083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562257-aef2-4b75-9497-70a1226700da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:51.708976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562257-aef2-4b75-9497-70a1226700da service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:51.726340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 991/1993] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:51 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:51.765161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1003/1994] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:51 2021] POST /identity/v3/projects => generated 361 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:51.771186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562257-aef2-4b75-9497-70a1226700da service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:51.785617 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:51.788666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:51.824327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562257-aef2-4b75-9497-70a1226700da service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:52.010292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a73a-5050-4dd6-9010-cb334ca60c83 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:52.020874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:52.022256 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.024253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.024942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] PATH_INFO: `/v3/users/df92ae7a27aa4167bc1477fde117ebcb` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:52.028401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df92ae7a27aa4167bc1477fde117ebcb)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:52.035144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:52.125421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:52.126466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.129179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.131132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:52.132285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:52.141656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:52.191457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df92ae7a27aa4167bc1477fde117ebcb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.214283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df92ae7a27aa4167bc1477fde117ebcb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.219651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df92ae7a27aa4167bc1477fde117ebcb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.219908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 992/1995] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:51 2021] POST /identity/v3/users => generated 281 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:52.221113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:52.222086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df92ae7a27aa4167bc1477fde117ebcb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.223891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:52.257022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df92ae7a27aa4167bc1477fde117ebcb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.260981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99daf45-8612-40ed-9825-7452eed20d03 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:52.274868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:52.276961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.277899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.278669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] PATH_INFO: `/v3/users/a40bbf2de51e477ba060d27c3245d796` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:52.281316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40bbf2de51e477ba060d27c3245d796)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:52.285732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:52.333910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1004/1996] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:51 2021] DELETE /identity/v3/users/df92ae7a27aa4167bc1477fde117ebcb => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:52.333910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:52.336605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:52.412257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40bbf2de51e477ba060d27c3245d796'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.435981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40bbf2de51e477ba060d27c3245d796'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.438246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40bbf2de51e477ba060d27c3245d796'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.440882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40bbf2de51e477ba060d27c3245d796'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.451571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3e91-1979-4458-a9ea-914ebf83a881 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:52.458152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60587151-f344-4bc9-857e-34994e8dcd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:52.459070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60587151-f344-4bc9-857e-34994e8dcd33 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.459513 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60587151-f344-4bc9-857e-34994e8dcd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.459966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60587151-f344-4bc9-857e-34994e8dcd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:52.460862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60587151-f344-4bc9-857e-34994e8dcd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:52.463436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60587151-f344-4bc9-857e-34994e8dcd33 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:52.465119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40bbf2de51e477ba060d27c3245d796'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:52.484766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1005/1997] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:52 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:52.487138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe297-f683-44cc-ad74-77e89513b449 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.487595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe297-f683-44cc-ad74-77e89513b449 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.488002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe297-f683-44cc-ad74-77e89513b449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:52.510507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 993/1998] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:52 2021] DELETE /identity/v3/users/a40bbf2de51e477ba060d27c3245d796 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:52.510774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:52.513058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:52.537897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-86abe297-f683-44cc-ad74-77e89513b449 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:52.539351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-86abe297-f683-44cc-ad74-77e89513b449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:52.648050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1006/1999] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:52.666733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abe297-f683-44cc-ad74-77e89513b449 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:52.672805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-86abe297-f683-44cc-ad74-77e89513b449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:52.682486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19260ae-72db-4a5d-940d-5a559a109425 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:52.693883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767fff3-ac2c-43f7-a382-a4a2803e7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:52.696257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fff3-ac2c-43f7-a382-a4a2803e7fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.697029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fff3-ac2c-43f7-a382-a4a2803e7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.697982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fff3-ac2c-43f7-a382-a4a2803e7fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:52.699282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767fff3-ac2c-43f7-a382-a4a2803e7fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:52.701405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767fff3-ac2c-43f7-a382-a4a2803e7fa6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:52.724714 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 994/2000] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:52 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:52.734272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767fff3-ac2c-43f7-a382-a4a2803e7fa6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:52.779088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767fff3-ac2c-43f7-a382-a4a2803e7fa6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:52.790223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37573a-6b78-435f-a528-603f844b6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:52.792191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37573a-6b78-435f-a528-603f844b6c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.792962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37573a-6b78-435f-a528-603f844b6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.793702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37573a-6b78-435f-a528-603f844b6c21 admin admin] PATH_INFO: `/v3/projects/4b4e379b89ed4376925def1487410075/users/359cd4409bdc42c6892224d9b9e99599/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:52.875184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37573a-6b78-435f-a528-603f844b6c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4e379b89ed4376925def1487410075, user_id=359cd4409bdc42c6892224d9b9e99599, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:52.880159 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abe297-f683-44cc-ad74-77e89513b449 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:52.885496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a9610-ebb5-4e83-b2c7-2e56ed8c3646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:52.886856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9610-ebb5-4e83-b2c7-2e56ed8c3646 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.887319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9610-ebb5-4e83-b2c7-2e56ed8c3646 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.887717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9610-ebb5-4e83-b2c7-2e56ed8c3646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:52.899135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37573a-6b78-435f-a528-603f844b6c21 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:52.902450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a9610-ebb5-4e83-b2c7-2e56ed8c3646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:52.904251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a9610-ebb5-4e83-b2c7-2e56ed8c3646 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:52.917629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1007/2001] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:52.932139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 995/2002] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:52 2021] PUT /identity/v3/projects/4b4e379b89ed4376925def1487410075/users/359cd4409bdc42c6892224d9b9e99599/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:52.946813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fb7e-234b-4b47-915b-326b2bdd6abd None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:52.947104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fb7e-234b-4b47-915b-326b2bdd6abd None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:52.947366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fb7e-234b-4b47-915b-326b2bdd6abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:53.036171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-21b4fb7e-234b-4b47-915b-326b2bdd6abd None None] MFA Rules not processed for user `359cd4409bdc42c6892224d9b9e99599`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:53.038537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-21b4fb7e-234b-4b47-915b-326b2bdd6abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:53.242261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1008/2003] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:52 2021] POST /identity/v3/auth/tokens => generated 3668 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:53.248513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37573a-6b78-435f-a528-603f844b6c21 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:53.271631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4fb7e-234b-4b47-915b-326b2bdd6abd None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:53.273120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-21b4fb7e-234b-4b47-915b-326b2bdd6abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:53.455765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37573a-6b78-435f-a528-603f844b6c21 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:53.472298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1259b-c17c-4bb5-845e-c8e11c4e6a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:53.473079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1259b-c17c-4bb5-845e-c8e11c4e6a15 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:53.473474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1259b-c17c-4bb5-845e-c8e11c4e6a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:53.473863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1259b-c17c-4bb5-845e-c8e11c4e6a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:53.474946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1259b-c17c-4bb5-845e-c8e11c4e6a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:53.478856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1259b-c17c-4bb5-845e-c8e11c4e6a15 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:53.489107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4fb7e-234b-4b47-915b-326b2bdd6abd None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:53.498704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:53.499558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:53.499850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:53.500134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] PATH_INFO: `/v3/projects/4a8a71f562124751a24c84588a42e5d5` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:53.506324 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8a71f562124751a24c84588a42e5d5)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:53.509537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:53.550623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 996/2004] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:53 2021] POST /identity/v3/projects => generated 365 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:53.552032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1259b-c17c-4bb5-845e-c8e11c4e6a15 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:53.635847 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8a71f562124751a24c84588a42e5d5', 'request_id': 'req-a9ecd9c7-9358-4329-b651-e09d7e0d2706'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:53.651039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8a71f562124751a24c84588a42e5d5', 'request_id': 'req-a9ecd9c7-9358-4329-b651-e09d7e0d2706'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:53.672509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8a71f562124751a24c84588a42e5d5', 'request_id': 'req-a9ecd9c7-9358-4329-b651-e09d7e0d2706'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:53.701121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] The token cache is being invalidate because project 4a8a71f562124751a24c84588a42e5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:53.701461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:53.703047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a9ecd9c7-9358-4329-b651-e09d7e0d2706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:53.705242 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1009/2005] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:53 2021] DELETE /identity/v3/projects/4a8a71f562124751a24c84588a42e5d5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:53.712937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80098-ac7a-41bd-8f86-2037f7f6bf74 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:53.713216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80098-ac7a-41bd-8f86-2037f7f6bf74 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:53.713504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80098-ac7a-41bd-8f86-2037f7f6bf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:53.729297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1259b-c17c-4bb5-845e-c8e11c4e6a15 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:53.770717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-bbf80098-ac7a-41bd-8f86-2037f7f6bf74 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:53.772740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bbf80098-ac7a-41bd-8f86-2037f7f6bf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:53.945609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2deb0-477c-4582-9e60-6eda0fb5a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:53.946453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2deb0-477c-4582-9e60-6eda0fb5a54a admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:53.946603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2deb0-477c-4582-9e60-6eda0fb5a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:53.946800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2deb0-477c-4582-9e60-6eda0fb5a54a admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:53.947510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2deb0-477c-4582-9e60-6eda0fb5a54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:53.949480 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2deb0-477c-4582-9e60-6eda0fb5a54a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:53.988805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1010/2006] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:53.989881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf80098-ac7a-41bd-8f86-2037f7f6bf74 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:53.992936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bbf80098-ac7a-41bd-8f86-2037f7f6bf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:54.000166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 997/2007] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:53 2021] POST /identity/v3/users => generated 289 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:54.004748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6eb4-aa4f-4e07-9bc8-e0b74cfd50f9 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.006034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf80098-ac7a-41bd-8f86-2037f7f6bf74 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.007603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6eb4-aa4f-4e07-9bc8-e0b74cfd50f9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.009112 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6eb4-aa4f-4e07-9bc8-e0b74cfd50f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.011297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.012115 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.012398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.012675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] PATH_INFO: `/v3/projects/2b73f173122a471d8d1203aaabbcd6db` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.014023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b73f173122a471d8d1203aaabbcd6db)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.016063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.083742 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a4aa6eb4-aa4f-4e07-9bc8-e0b74cfd50f9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:54.087134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a4aa6eb4-aa4f-4e07-9bc8-e0b74cfd50f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:54.112413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b73f173122a471d8d1203aaabbcd6db', 'request_id': 'req-ffa218a0-644d-4464-b5bc-47bd5e2465d2'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:54.128136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b73f173122a471d8d1203aaabbcd6db', 'request_id': 'req-ffa218a0-644d-4464-b5bc-47bd5e2465d2'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:54.153295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b73f173122a471d8d1203aaabbcd6db', 'request_id': 'req-ffa218a0-644d-4464-b5bc-47bd5e2465d2'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:54.188445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] The token cache is being invalidate because project 2b73f173122a471d8d1203aaabbcd6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:54.190613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:54.194517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:54.196850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1011/2008] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:53 2021] DELETE /identity/v3/projects/2b73f173122a471d8d1203aaabbcd6db => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:54.197993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.202634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:54.269609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 998/2009] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:54.272686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6948-58ef-47f5-b6e8-a19180342a96 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.272958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6948-58ef-47f5-b6e8-a19180342a96 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.275215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6948-58ef-47f5-b6e8-a19180342a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.330861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-799e6948-58ef-47f5-b6e8-a19180342a96 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:54.336322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-799e6948-58ef-47f5-b6e8-a19180342a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:54.355138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 999/2010] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:54.356132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e6948-58ef-47f5-b6e8-a19180342a96 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.392183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e6948-58ef-47f5-b6e8-a19180342a96 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.401999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa218a0-644d-4464-b5bc-47bd5e2465d2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.404286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce577a0-9029-4d78-bacc-411d95d359ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.404961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce577a0-9029-4d78-bacc-411d95d359ba admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.405245 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce577a0-9029-4d78-bacc-411d95d359ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.405980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce577a0-9029-4d78-bacc-411d95d359ba admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.406739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce577a0-9029-4d78-bacc-411d95d359ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:54.407507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce577a0-9029-4d78-bacc-411d95d359ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.409136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce577a0-9029-4d78-bacc-411d95d359ba admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.426684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f6dad-55f0-4497-a5ad-279d288b9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.426684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f6dad-55f0-4497-a5ad-279d288b9d41 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.426684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f6dad-55f0-4497-a5ad-279d288b9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.426684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f6dad-55f0-4497-a5ad-279d288b9d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.427438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f6dad-55f0-4497-a5ad-279d288b9d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.427438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f6dad-55f0-4497-a5ad-279d288b9d41 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.451258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1000/2011] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:54.452771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1012/2012] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:54 2021] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:54.454740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f6dad-55f0-4497-a5ad-279d288b9d41 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.455068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb1a3-642c-46af-b2c8-3e1f0fe8fd49 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.455392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb1a3-642c-46af-b2c8-3e1f0fe8fd49 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.455683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb1a3-642c-46af-b2c8-3e1f0fe8fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.481669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f6dad-55f0-4497-a5ad-279d288b9d41 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.499547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca4e2b-0b57-4e1b-aee4-27b5c3a8a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.501076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4e2b-0b57-4e1b-aee4-27b5c3a8a398 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.501076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4e2b-0b57-4e1b-aee4-27b5c3a8a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.501076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4e2b-0b57-4e1b-aee4-27b5c3a8a398 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.501543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca4e2b-0b57-4e1b-aee4-27b5c3a8a398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.503753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca4e2b-0b57-4e1b-aee4-27b5c3a8a398 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.513507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c84fb1a3-642c-46af-b2c8-3e1f0fe8fd49 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:54.516209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c84fb1a3-642c-46af-b2c8-3e1f0fe8fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:54.534656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1001/2013] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:54.536726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb1a3-642c-46af-b2c8-3e1f0fe8fd49 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.540840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1013/2014] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:54 2021] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:54.545745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca4e2b-0b57-4e1b-aee4-27b5c3a8a398 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.557982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb1a3-642c-46af-b2c8-3e1f0fe8fd49 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.686738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f1b4b-d132-4f05-8060-4a0be0a96d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.688115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f1b4b-d132-4f05-8060-4a0be0a96d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.688553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f1b4b-d132-4f05-8060-4a0be0a96d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.688938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f1b4b-d132-4f05-8060-4a0be0a96d40 admin admin] PATH_INFO: `/v3/projects/0f8b0035880c4833a09e036faa4e2869/users/01c56e90f33a4e0b80317e4fbc608f38/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.696253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca4e2b-0b57-4e1b-aee4-27b5c3a8a398 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.706790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.707652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.708800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.709233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.710441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:58:54.710901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.714684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.720758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f1b4b-d132-4f05-8060-4a0be0a96d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8b0035880c4833a09e036faa4e2869, user_id=01c56e90f33a4e0b80317e4fbc608f38, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.724207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f1b4b-d132-4f05-8060-4a0be0a96d40 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.743442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1014/2015] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:58:54.745106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.757589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1002/2016] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:54 2021] PUT /identity/v3/projects/0f8b0035880c4833a09e036faa4e2869/users/01c56e90f33a4e0b80317e4fbc608f38/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:54.759585 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f1b4b-d132-4f05-8060-4a0be0a96d40 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.769340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb94ee-76ec-4409-b051-7fcd46dd2390 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.894048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27927b-d011-4e77-9366-55b3757e5692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.895431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27927b-d011-4e77-9366-55b3757e5692 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.895984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27927b-d011-4e77-9366-55b3757e5692 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.896464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27927b-d011-4e77-9366-55b3757e5692 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.900670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27927b-d011-4e77-9366-55b3757e5692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.904388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27927b-d011-4e77-9366-55b3757e5692 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.934316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1015/2017] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:54 2021] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:54.939401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27927b-d011-4e77-9366-55b3757e5692 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.950356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27927b-d011-4e77-9366-55b3757e5692 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.955411 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8b411-5088-40b7-a4b3-a3b90aa01d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.956219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b411-5088-40b7-a4b3-a3b90aa01d36 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.956397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b411-5088-40b7-a4b3-a3b90aa01d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.956631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b411-5088-40b7-a4b3-a3b90aa01d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.957347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8b411-5088-40b7-a4b3-a3b90aa01d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.959443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8b411-5088-40b7-a4b3-a3b90aa01d36 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.968595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f1b4b-d132-4f05-8060-4a0be0a96d40 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.971810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1016/2018] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:54.972712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8b411-5088-40b7-a4b3-a3b90aa01d36 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:54.979685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280462-b0b3-4293-83fe-3d089dc48979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.980425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280462-b0b3-4293-83fe-3d089dc48979 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.980788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280462-b0b3-4293-83fe-3d089dc48979 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.981140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280462-b0b3-4293-83fe-3d089dc48979 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.981869 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280462-b0b3-4293-83fe-3d089dc48979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.984238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8b411-5088-40b7-a4b3-a3b90aa01d36 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:54.984414 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280462-b0b3-4293-83fe-3d089dc48979 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:54.988956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bb3cf-70e0-4b5d-bb8c-ae5ba1ef2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:54.989686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bb3cf-70e0-4b5d-bb8c-ae5ba1ef2390 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:54.990041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bb3cf-70e0-4b5d-bb8c-ae5ba1ef2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:54.990389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bb3cf-70e0-4b5d-bb8c-ae5ba1ef2390 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:54.991203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bb3cf-70e0-4b5d-bb8c-ae5ba1ef2390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:54.993080 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bb3cf-70e0-4b5d-bb8c-ae5ba1ef2390 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:55.015147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1017/2019] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:54 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:55.015147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bb3cf-70e0-4b5d-bb8c-ae5ba1ef2390 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:55.027450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1003/2020] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:54 2021] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:55.028732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280462-b0b3-4293-83fe-3d089dc48979 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:55.032277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bb3cf-70e0-4b5d-bb8c-ae5ba1ef2390 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:55.113892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24952a0-7f2b-4518-a0bb-c43094f903e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:55.115473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24952a0-7f2b-4518-a0bb-c43094f903e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.115940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24952a0-7f2b-4518-a0bb-c43094f903e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.116168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24952a0-7f2b-4518-a0bb-c43094f903e2 admin admin] PATH_INFO: `/v3/projects/0f8b0035880c4833a09e036faa4e2869/users/01c56e90f33a4e0b80317e4fbc608f38/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.119473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24952a0-7f2b-4518-a0bb-c43094f903e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8b0035880c4833a09e036faa4e2869, user_id=01c56e90f33a4e0b80317e4fbc608f38, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:55.123914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24952a0-7f2b-4518-a0bb-c43094f903e2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:55.139411 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1018/2021] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:55 2021] PUT /identity/v3/projects/0f8b0035880c4833a09e036faa4e2869/users/01c56e90f33a4e0b80317e4fbc608f38/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:55.146669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24952a0-7f2b-4518-a0bb-c43094f903e2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:55.159972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280462-b0b3-4293-83fe-3d089dc48979 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:55.252103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24952a0-7f2b-4518-a0bb-c43094f903e2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:55.267543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fa7c0-e5d4-4b34-90f9-3cd17bff011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:55.270792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa7c0-e5d4-4b34-90f9-3cd17bff011d admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.271861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa7c0-e5d4-4b34-90f9-3cd17bff011d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.272156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa7c0-e5d4-4b34-90f9-3cd17bff011d admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.274990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fa7c0-e5d4-4b34-90f9-3cd17bff011d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:55.280835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fa7c0-e5d4-4b34-90f9-3cd17bff011d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:55.333165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec2314-f56e-4c4e-963b-8aa3b067ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:55.334693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec2314-f56e-4c4e-963b-8aa3b067ac75 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.335427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec2314-f56e-4c4e-963b-8aa3b067ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.337126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec2314-f56e-4c4e-963b-8aa3b067ac75 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.349846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec2314-f56e-4c4e-963b-8aa3b067ac75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:55.357206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec2314-f56e-4c4e-963b-8aa3b067ac75 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:55.365016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1019/2022] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:55 2021] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:55.369269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333796b-dc4e-4e8f-b6a7-6f3157bb6b3a None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.369841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333796b-dc4e-4e8f-b6a7-6f3157bb6b3a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.370306 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333796b-dc4e-4e8f-b6a7-6f3157bb6b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.449058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1004/2023] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:55 2021] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:55.453942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec2314-f56e-4c4e-963b-8aa3b067ac75 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:55.503650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec2314-f56e-4c4e-963b-8aa3b067ac75 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:55.514085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58cbd-41f4-431b-ae73-dc8ec13cd491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:55.515175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58cbd-41f4-431b-ae73-dc8ec13cd491 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.515802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58cbd-41f4-431b-ae73-dc8ec13cd491 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.516087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58cbd-41f4-431b-ae73-dc8ec13cd491 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.522268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58cbd-41f4-431b-ae73-dc8ec13cd491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:55.530839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58cbd-41f4-431b-ae73-dc8ec13cd491 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:55.540113 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7333796b-dc4e-4e8f-b6a7-6f3157bb6b3a None None] MFA Rules not processed for user `01c56e90f33a4e0b80317e4fbc608f38`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:55.543495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7333796b-dc4e-4e8f-b6a7-6f3157bb6b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:55.585363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1005/2024] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:55 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:55.588948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58cbd-41f4-431b-ae73-dc8ec13cd491 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:55.627270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58cbd-41f4-431b-ae73-dc8ec13cd491 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:55.644136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:55.645530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.646007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.646504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] PATH_INFO: `/v3/projects/57cf7589ba804b2fadb9c145805095fa/users/c287a358baba476e968e51ec890ce7d3/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.713009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cf7589ba804b2fadb9c145805095fa, user_id=c287a358baba476e968e51ec890ce7d3, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:55.715780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:55.725808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1020/2025] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:55 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:55.731273 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333796b-dc4e-4e8f-b6a7-6f3157bb6b3a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:55.748309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1006/2026] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:55 2021] PUT /identity/v3/projects/57cf7589ba804b2fadb9c145805095fa/users/c287a358baba476e968e51ec890ce7d3/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:55.760549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:55.763207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:55.775440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333796b-dc4e-4e8f-b6a7-6f3157bb6b3a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:55.923894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff625c3-e821-4397-806e-1095119cb869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:55.925065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff625c3-e821-4397-806e-1095119cb869 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.925561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff625c3-e821-4397-806e-1095119cb869 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.926256 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff625c3-e821-4397-806e-1095119cb869 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.927213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff625c3-e821-4397-806e-1095119cb869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:55.930891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff625c3-e821-4397-806e-1095119cb869 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:55.938748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22cfb-6e25-4509-869d-f959ee12ed86 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:55.946103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1021/2027] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:55 2021] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:55.947868 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8ee9-e8b4-4a16-972e-677ef0d95fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:55.948259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59854b6b-0260-40c7-a14f-9c989f6875b3 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.948705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59854b6b-0260-40c7-a14f-9c989f6875b3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.948900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8ee9-e8b4-4a16-972e-677ef0d95fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:55.949254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59854b6b-0260-40c7-a14f-9c989f6875b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.949501 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8ee9-e8b4-4a16-972e-677ef0d95fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:55.950016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8ee9-e8b4-4a16-972e-677ef0d95fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:55.997712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-59854b6b-0260-40c7-a14f-9c989f6875b3 None None] MFA Rules not processed for user `c287a358baba476e968e51ec890ce7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:55.999095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-59854b6b-0260-40c7-a14f-9c989f6875b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:56.058041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d8ee9-e8b4-4a16-972e-677ef0d95fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:56.059697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d8ee9-e8b4-4a16-972e-677ef0d95fb1 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:56.082940 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1007/2028] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:55 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:56.084010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8ee9-e8b4-4a16-972e-677ef0d95fb1 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:56.107636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8ee9-e8b4-4a16-972e-677ef0d95fb1 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:56.107915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1022/2029] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:55 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:56.116653 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59854b6b-0260-40c7-a14f-9c989f6875b3 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:56.119182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde509a-0dbf-476c-ba90-36bbe5e797ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:56.120028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde509a-0dbf-476c-ba90-36bbe5e797ea admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.120314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde509a-0dbf-476c-ba90-36bbe5e797ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.120635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde509a-0dbf-476c-ba90-36bbe5e797ea admin admin] PATH_INFO: `/v3/projects/65f8b2bf0c6e4c1684ec07a4fd6e2030/users/335796f0c1f84f528a0b6079a0ee3775/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:56.131691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59854b6b-0260-40c7-a14f-9c989f6875b3 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:56.141875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990c677-5550-409d-a7b2-44dd64d949c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:56.142550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990c677-5550-409d-a7b2-44dd64d949c2 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.142883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990c677-5550-409d-a7b2-44dd64d949c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.143211 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990c677-5550-409d-a7b2-44dd64d949c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:56.143883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990c677-5550-409d-a7b2-44dd64d949c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:56.146022 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990c677-5550-409d-a7b2-44dd64d949c2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:56.175164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde509a-0dbf-476c-ba90-36bbe5e797ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f8b2bf0c6e4c1684ec07a4fd6e2030, user_id=335796f0c1f84f528a0b6079a0ee3775, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:56.179553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde509a-0dbf-476c-ba90-36bbe5e797ea admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:56.185133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1023/2030] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:58:56 2021] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:58:56.197215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990c677-5550-409d-a7b2-44dd64d949c2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:56.221321 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1008/2031] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:56 2021] PUT /identity/v3/projects/65f8b2bf0c6e4c1684ec07a4fd6e2030/users/335796f0c1f84f528a0b6079a0ee3775/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:56.223740 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6352-ffa7-4373-8d9f-5734766209c6 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.224997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6352-ffa7-4373-8d9f-5734766209c6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.225506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6352-ffa7-4373-8d9f-5734766209c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:56.283361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a63f6352-ffa7-4373-8d9f-5734766209c6 None None] MFA Rules not processed for user `335796f0c1f84f528a0b6079a0ee3775`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:56.285373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a63f6352-ffa7-4373-8d9f-5734766209c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:56.372283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990c677-5550-409d-a7b2-44dd64d949c2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:56.487694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1009/2032] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:56 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:56.552567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6352-ffa7-4373-8d9f-5734766209c6 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:56.611900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:56.612896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.613375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.613839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:56.614951 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:56.617680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:56.644312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1024/2033] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:58:56 2021] POST /identity/v3/users => generated 293 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:58:56.645787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:56.647753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:56.723283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6352-ffa7-4373-8d9f-5734766209c6 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:56.732306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:56.733565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.733956 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.734232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] PATH_INFO: `/v3/users/359cd4409bdc42c6892224d9b9e99599` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:56.735925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359cd4409bdc42c6892224d9b9e99599)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:56.747838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c1e89-5395-4b61-a4f4-4ca1a25fecd2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:56.748330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:56.752493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da78dc8-fa19-4525-9578-edcaa35a58b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:56.753423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da78dc8-fa19-4525-9578-edcaa35a58b8 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.753911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da78dc8-fa19-4525-9578-edcaa35a58b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.754281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da78dc8-fa19-4525-9578-edcaa35a58b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:56.775182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da78dc8-fa19-4525-9578-edcaa35a58b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:56.776845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da78dc8-fa19-4525-9578-edcaa35a58b8 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:56.807670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1025/2034] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:56 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:56.808867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da78dc8-fa19-4525-9578-edcaa35a58b8 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:56.843207 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da78dc8-fa19-4525-9578-edcaa35a58b8 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:56.862043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359cd4409bdc42c6892224d9b9e99599'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:56.880598 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:56.886554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359cd4409bdc42c6892224d9b9e99599'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:56.887278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.887449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359cd4409bdc42c6892224d9b9e99599'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:56.888485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359cd4409bdc42c6892224d9b9e99599'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:56.890793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.891990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:56.895948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:56.900184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d40e4220-b394-43b6-9891-5aa78fe9a351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359cd4409bdc42c6892224d9b9e99599'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:56.903947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:56.929083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1026/2035] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:56 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:56.930544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:56.932701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:56.948430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c2ef-e453-4107-92c8-9489e77ad152 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:56.955433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9ba3-d569-4fc1-88dd-ef2109034e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:56.956326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9ba3-d569-4fc1-88dd-ef2109034e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.956662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9ba3-d569-4fc1-88dd-ef2109034e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.957914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9ba3-d569-4fc1-88dd-ef2109034e46 admin admin] PATH_INFO: `/v3/projects/da0f13f97f4b48e2b4e3d6b2d020fbb3/users/155cf444f39541e0b60a0af3d097729b/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:56.985807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1010/2036] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:56 2021] DELETE /identity/v3/users/359cd4409bdc42c6892224d9b9e99599 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:56.987915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9ba3-d569-4fc1-88dd-ef2109034e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0f13f97f4b48e2b4e3d6b2d020fbb3, user_id=155cf444f39541e0b60a0af3d097729b, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:56.991414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9ba3-d569-4fc1-88dd-ef2109034e46 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:56.991739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa11d-5b3b-4e7b-a2c7-d65bf0d3b34e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:56.992557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa11d-5b3b-4e7b-a2c7-d65bf0d3b34e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:56.992839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa11d-5b3b-4e7b-a2c7-d65bf0d3b34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:57.024591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1027/2037] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:56 2021] PUT /identity/v3/projects/da0f13f97f4b48e2b4e3d6b2d020fbb3/users/155cf444f39541e0b60a0af3d097729b/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:57.025761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9ba3-d569-4fc1-88dd-ef2109034e46 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:57.048580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-bb3aa11d-5b3b-4e7b-a2c7-d65bf0d3b34e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:57.049440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bb3aa11d-5b3b-4e7b-a2c7-d65bf0d3b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:57.220370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9ba3-d569-4fc1-88dd-ef2109034e46 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:57.241877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5d196-a6f4-4080-ab45-99269c7e33a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:57.244397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5d196-a6f4-4080-ab45-99269c7e33a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:57.246844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5d196-a6f4-4080-ab45-99269c7e33a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:57.247333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5d196-a6f4-4080-ab45-99269c7e33a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:57.248385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5d196-a6f4-4080-ab45-99269c7e33a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:57.252832 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5d196-a6f4-4080-ab45-99269c7e33a5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:57.271640 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1028/2038] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:58:57 2021] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:58:57.274656 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5d196-a6f4-4080-ab45-99269c7e33a5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:57.283247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1011/2039] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:58:57.299033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5d196-a6f4-4080-ab45-99269c7e33a5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:57.312437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:57.313295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:57.313588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:57.313872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] PATH_INFO: `/v3/projects/da0f13f97f4b48e2b4e3d6b2d020fbb3/users/155cf444f39541e0b60a0af3d097729b/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:57.317550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0f13f97f4b48e2b4e3d6b2d020fbb3, user_id=155cf444f39541e0b60a0af3d097729b, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:57.329698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:57.354442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1029/2040] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:58:57 2021] PUT /identity/v3/projects/da0f13f97f4b48e2b4e3d6b2d020fbb3/users/155cf444f39541e0b60a0af3d097729b/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:57.366381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c73-c98a-40da-8aff-f2216a3ef8cf None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:57.366715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c73-c98a-40da-8aff-f2216a3ef8cf None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:57.367040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c73-c98a-40da-8aff-f2216a3ef8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:57.420939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-40197c73-c98a-40da-8aff-f2216a3ef8cf None None] MFA Rules not processed for user `155cf444f39541e0b60a0af3d097729b`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:57.424428 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-40197c73-c98a-40da-8aff-f2216a3ef8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:57.437450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:57.442233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:57.638333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb610f-f95d-460c-92f6-8a36802cee49 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:57.639656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1012/2041] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:57 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:57.656857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:57.658332 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:57.659474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:57.660216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:57.679318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40197c73-c98a-40da-8aff-f2216a3ef8cf None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:57.680960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-40197c73-c98a-40da-8aff-f2216a3ef8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:57.917206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:57.919169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:57.949323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1030/2042] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:57.990670 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40197c73-c98a-40da-8aff-f2216a3ef8cf None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:58.010114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3587649-41e1-4322-819a-e3d539455334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:58.011458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3587649-41e1-4322-819a-e3d539455334 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:58.012614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3587649-41e1-4322-819a-e3d539455334 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:58.014713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3587649-41e1-4322-819a-e3d539455334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:58.058829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3587649-41e1-4322-819a-e3d539455334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:58.061836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3587649-41e1-4322-819a-e3d539455334 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:58.092459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1013/2043] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:57 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:58.448315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:58.450807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:58.479840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc6efa-6224-4c49-acd5-bb40c0f2a457 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:58.491552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:58.495317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:58.496315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:58.497016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] PATH_INFO: `/v3/users/9fc5ab30f0d0428dada88a3a1fab0332` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:58.501014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc5ab30f0d0428dada88a3a1fab0332)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:58.507417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:58.593720 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc5ab30f0d0428dada88a3a1fab0332'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:58.612805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc5ab30f0d0428dada88a3a1fab0332'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:58.613668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc5ab30f0d0428dada88a3a1fab0332'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:58.614626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc5ab30f0d0428dada88a3a1fab0332'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:58.641818 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc5ab30f0d0428dada88a3a1fab0332'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:58.661614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1031/2044] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:58 2021] DELETE /identity/v3/users/9fc5ab30f0d0428dada88a3a1fab0332 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:58:58.669306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc201-ecb1-412d-8807-69645970e27d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:58.671920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc201-ecb1-412d-8807-69645970e27d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:58.673000 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc201-ecb1-412d-8807-69645970e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:58.754430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:58.756672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:58.765897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-fabbc201-ecb1-412d-8807-69645970e27d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:58.768251 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fabbc201-ecb1-412d-8807-69645970e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:58.932319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e331a-123b-4a3c-9bb5-7a177bac3c45 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:58.937728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:58.938713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:58.939004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:58.939284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] PATH_INFO: `/v3/users/c287a358baba476e968e51ec890ce7d3` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:58.940655 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c287a358baba476e968e51ec890ce7d3)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:58.942908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:59.021075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c287a358baba476e968e51ec890ce7d3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.034776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c287a358baba476e968e51ec890ce7d3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.035584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c287a358baba476e968e51ec890ce7d3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.036296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c287a358baba476e968e51ec890ce7d3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.061562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4079b595-4a8b-4cef-b1d2-f90153edb15c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c287a358baba476e968e51ec890ce7d3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.080764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1032/2045] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:58 2021] DELETE /identity/v3/users/c287a358baba476e968e51ec890ce7d3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:59.088873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37868b-9854-4741-9cec-4a13247db0b3 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:59.089254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37868b-9854-4741-9cec-4a13247db0b3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:59.089615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37868b-9854-4741-9cec-4a13247db0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:59.109915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1014/2046] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:59.138066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0b37868b-9854-4741-9cec-4a13247db0b3 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:58:59.139350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0b37868b-9854-4741-9cec-4a13247db0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:59.160127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbc201-ecb1-412d-8807-69645970e27d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:59.162340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fabbc201-ecb1-412d-8807-69645970e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:59.288408 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1033/2047] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:58:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:58:59.314995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbc201-ecb1-412d-8807-69645970e27d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:59.321193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37868b-9854-4741-9cec-4a13247db0b3 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:59.323906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0b37868b-9854-4741-9cec-4a13247db0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:59.445731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37868b-9854-4741-9cec-4a13247db0b3 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:59.451695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:59.452757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:59.452757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:59.454233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:59.465689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:59.467186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:59.479886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1034/2048] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:58:59.486501 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c655-c623-451f-98a7-ee564945fbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:59.491518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c655-c623-451f-98a7-ee564945fbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:59.492717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c655-c623-451f-98a7-ee564945fbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:59.496319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c655-c623-451f-98a7-ee564945fbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:59.518054 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86c655-c623-451f-98a7-ee564945fbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:59.520102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86c655-c623-451f-98a7-ee564945fbe0 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:59.536383 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1015/2049] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:58:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:58:59.580459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:59.582215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:58:59.614139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a99f3-d090-4350-ab7d-746b031354cd service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:59.630766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:59.632250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:59.633448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:59.633911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] PATH_INFO: `/v3/projects/4b4e379b89ed4376925def1487410075` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:59.636536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4e379b89ed4376925def1487410075)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:58:59.640232 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:58:59.788252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4e379b89ed4376925def1487410075', 'request_id': 'req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.796385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4e379b89ed4376925def1487410075', 'request_id': 'req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.807726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4e379b89ed4376925def1487410075', 'request_id': 'req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.867491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] The token cache is being invalidate because project 4b4e379b89ed4376925def1487410075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:58:59.868437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.869848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:58:59.872754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1035/2050] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:58:59 2021] DELETE /identity/v3/projects/4b4e379b89ed4376925def1487410075 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:58:59.879036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c655-c623-451f-98a7-ee564945fbe0 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:58:59.889713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c655-c623-451f-98a7-ee564945fbe0 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:58:59.994841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:58:59.996156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:58:59.996653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:58:59.997130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] PATH_INFO: `/v3/users/01c56e90f33a4e0b80317e4fbc608f38` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:58:59.999056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c56e90f33a4e0b80317e4fbc608f38)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:00.001213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:00.071551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c56e90f33a4e0b80317e4fbc608f38'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:00.085393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c56e90f33a4e0b80317e4fbc608f38'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:00.087211 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c56e90f33a4e0b80317e4fbc608f38'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:00.088085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c56e90f33a4e0b80317e4fbc608f38'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:00.116594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c56e90f33a4e0b80317e4fbc608f38'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:00.179795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1016/2051] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:58:59 2021] DELETE /identity/v3/users/01c56e90f33a4e0b80317e4fbc608f38 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:00.900692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:00.903001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:00.923981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:00.926644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:00.944980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb50d7-544e-4d46-9a31-8b6acd7a29e8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:01.049522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07709d6-d6e1-4153-8103-0da9865e77d7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:01.055583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:01.056639 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:01.056997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:01.057351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] PATH_INFO: `/v3/projects/b9b4ec021316452fb176083144491682` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:01.059056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b4ec021316452fb176083144491682)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:01.061152 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:01.100353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:01.102933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:01.103676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:01.104253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] PATH_INFO: `/v3/users/7feb8b5d7717496ca93d7fea64a89ca0` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:01.107608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7feb8b5d7717496ca93d7fea64a89ca0)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:01.113497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:01.143710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b4ec021316452fb176083144491682', 'request_id': 'req-d1db7b30-6b53-4562-a47a-606e3fab6396'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.150069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b4ec021316452fb176083144491682', 'request_id': 'req-d1db7b30-6b53-4562-a47a-606e3fab6396'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.163516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b4ec021316452fb176083144491682', 'request_id': 'req-d1db7b30-6b53-4562-a47a-606e3fab6396'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.192096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] The token cache is being invalidate because project b9b4ec021316452fb176083144491682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:01.192770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.194108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.202510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1017/2052] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:00 2021] DELETE /identity/v3/projects/b9b4ec021316452fb176083144491682 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:01.205253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:01.207597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:01.244730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7feb8b5d7717496ca93d7fea64a89ca0'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.264770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7feb8b5d7717496ca93d7fea64a89ca0'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.266179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7feb8b5d7717496ca93d7fea64a89ca0'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.267287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7feb8b5d7717496ca93d7fea64a89ca0'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.302604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7feb8b5d7717496ca93d7fea64a89ca0'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.334723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db7b30-6b53-4562-a47a-606e3fab6396 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:01.336667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1036/2053] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:00 2021] DELETE /identity/v3/users/7feb8b5d7717496ca93d7fea64a89ca0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:01.482589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:01.482589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:01.482589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:01.482589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] PATH_INFO: `/v3/users/b7287812566f45ffaf81aae084314bcb` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:01.483287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7287812566f45ffaf81aae084314bcb)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:01.486286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:01.575617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7287812566f45ffaf81aae084314bcb'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.587322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7287812566f45ffaf81aae084314bcb'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.588096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7287812566f45ffaf81aae084314bcb'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.588778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7287812566f45ffaf81aae084314bcb'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.612839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7287812566f45ffaf81aae084314bcb'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:01.650605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1018/2054] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:01 2021] DELETE /identity/v3/users/b7287812566f45ffaf81aae084314bcb => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:01.980830 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:01.986203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:01.991691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:01.996503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:02.065064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccb659-2c49-463b-9a30-f9a2bd117396 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:02.195929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c9ecc-9623-4055-80d8-66903d30499a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:02.220514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:02.221565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:02.221760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:02.221936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] PATH_INFO: `/v3/projects/ccbb76292ff94c57a48ed3833187805d` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:02.228908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbb76292ff94c57a48ed3833187805d)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:02.233092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:02.384056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbb76292ff94c57a48ed3833187805d', 'request_id': 'req-b64f6053-f32d-4248-97dc-99b9e86b969a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.397081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbb76292ff94c57a48ed3833187805d', 'request_id': 'req-b64f6053-f32d-4248-97dc-99b9e86b969a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.415841 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbb76292ff94c57a48ed3833187805d', 'request_id': 'req-b64f6053-f32d-4248-97dc-99b9e86b969a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.451503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] The token cache is being invalidate because project ccbb76292ff94c57a48ed3833187805d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:02.453219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:02.454202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.456024 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.457971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:02.461507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:02.462079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1019/2055] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:01 2021] DELETE /identity/v3/projects/ccbb76292ff94c57a48ed3833187805d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:02.462947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] PATH_INFO: `/v3/projects/57cf7589ba804b2fadb9c145805095fa` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:02.467446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cf7589ba804b2fadb9c145805095fa)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:02.470144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:02.480974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:02.482607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:02.666642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f6053-f32d-4248-97dc-99b9e86b969a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:02.666968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cf7589ba804b2fadb9c145805095fa', 'request_id': 'req-f8256232-49ef-4a13-aeb4-be729ef120fa'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.677584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cf7589ba804b2fadb9c145805095fa', 'request_id': 'req-f8256232-49ef-4a13-aeb4-be729ef120fa'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.694667 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cf7589ba804b2fadb9c145805095fa', 'request_id': 'req-f8256232-49ef-4a13-aeb4-be729ef120fa'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.745608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] The token cache is being invalidate because project 57cf7589ba804b2fadb9c145805095fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:02.748601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.751985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:02.756730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1037/2056] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:01 2021] DELETE /identity/v3/projects/57cf7589ba804b2fadb9c145805095fa => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:02.757661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:02.763983 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:02.843280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:02.845226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:02.845979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:02.846656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] PATH_INFO: `/v3/users/670bde456aae4c1fbc52123d7c9951d5` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:02.849671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=670bde456aae4c1fbc52123d7c9951d5)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:02.854285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:02.979150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8256232-49ef-4a13-aeb4-be729ef120fa admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:02.985151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:02.986127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:02.986386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:02.986723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] PATH_INFO: `/v3/projects/0f8b0035880c4833a09e036faa4e2869` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:02.988674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f8b0035880c4833a09e036faa4e2869)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:02.992822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:02.999968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670bde456aae4c1fbc52123d7c9951d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.013315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670bde456aae4c1fbc52123d7c9951d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.014485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670bde456aae4c1fbc52123d7c9951d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.015553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670bde456aae4c1fbc52123d7c9951d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.028337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670bde456aae4c1fbc52123d7c9951d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.053696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1020/2057] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:02 2021] DELETE /identity/v3/users/670bde456aae4c1fbc52123d7c9951d5 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:03.055990 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:03.058690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.085096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8b0035880c4833a09e036faa4e2869', 'request_id': 'req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.101602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8b0035880c4833a09e036faa4e2869', 'request_id': 'req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.115202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8b0035880c4833a09e036faa4e2869', 'request_id': 'req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.151861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] The token cache is being invalidate because project 0f8b0035880c4833a09e036faa4e2869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:03.152282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.153466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.160209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1038/2058] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:02 2021] DELETE /identity/v3/projects/0f8b0035880c4833a09e036faa4e2869 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:03.161082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:03.165130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.228053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac546e-c200-463c-843e-8135d0835418 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:03.233449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:03.234340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.234945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.235235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] PATH_INFO: `/v3/users/155cf444f39541e0b60a0af3d097729b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.236497 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155cf444f39541e0b60a0af3d097729b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:03.238727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:03.315954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e53aa-d8c6-45de-8aac-ba03eafbf8d3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:03.316280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155cf444f39541e0b60a0af3d097729b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.323414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:03.324016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.324320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.325141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] PATH_INFO: `/v3/projects/535d683b36f34a0198153bb82c44e3c1` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.326561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] RBAC: Authorizing `identity:delete_project(project_id=535d683b36f34a0198153bb82c44e3c1)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:03.329052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:03.344302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155cf444f39541e0b60a0af3d097729b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.348479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155cf444f39541e0b60a0af3d097729b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.353574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155cf444f39541e0b60a0af3d097729b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.372262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f69333b8-2731-4fb1-a39d-ebda74b58199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155cf444f39541e0b60a0af3d097729b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.397050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1021/2059] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:03 2021] DELETE /identity/v3/users/155cf444f39541e0b60a0af3d097729b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:03.400369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c656db-ddaf-46ff-912f-ea0a459bb75b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.400369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c656db-ddaf-46ff-912f-ea0a459bb75b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.400369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c656db-ddaf-46ff-912f-ea0a459bb75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.406607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535d683b36f34a0198153bb82c44e3c1', 'request_id': 'req-e21e2777-b8a3-4af1-98c5-b9e12b96059a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.420091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535d683b36f34a0198153bb82c44e3c1', 'request_id': 'req-e21e2777-b8a3-4af1-98c5-b9e12b96059a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.432002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535d683b36f34a0198153bb82c44e3c1', 'request_id': 'req-e21e2777-b8a3-4af1-98c5-b9e12b96059a'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.444988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-06c656db-ddaf-46ff-912f-ea0a459bb75b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:03.445426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-06c656db-ddaf-46ff-912f-ea0a459bb75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.464877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] The token cache is being invalidate because project 535d683b36f34a0198153bb82c44e3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:03.465336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.466575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.469144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1039/2060] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:03 2021] DELETE /identity/v3/projects/535d683b36f34a0198153bb82c44e3c1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:03.471976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:03.480827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.574624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1022/2061] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:03.576737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900275df-b60c-40c9-9c79-c51d76ba9e35 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.576737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900275df-b60c-40c9-9c79-c51d76ba9e35 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.576737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900275df-b60c-40c9-9c79-c51d76ba9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.590050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2777-b8a3-4af1-98c5-b9e12b96059a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:03.597529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:03.598863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.599237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.599911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] PATH_INFO: `/v3/projects/371ee3d385e0484db19eb9102133598c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.602251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371ee3d385e0484db19eb9102133598c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:03.604878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:03.616686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-900275df-b60c-40c9-9c79-c51d76ba9e35 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:03.618586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-900275df-b60c-40c9-9c79-c51d76ba9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.627654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1023/2062] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:03.629109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263b7b-6663-455a-b239-96128b863270 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.629473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263b7b-6663-455a-b239-96128b863270 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.629826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263b7b-6663-455a-b239-96128b863270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.657391 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-91263b7b-6663-455a-b239-96128b863270 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:03.659027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-91263b7b-6663-455a-b239-96128b863270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.675018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371ee3d385e0484db19eb9102133598c', 'request_id': 'req-747c9e48-0835-42b1-8e97-38cad8ce8918'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.683920 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371ee3d385e0484db19eb9102133598c', 'request_id': 'req-747c9e48-0835-42b1-8e97-38cad8ce8918'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.695605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371ee3d385e0484db19eb9102133598c', 'request_id': 'req-747c9e48-0835-42b1-8e97-38cad8ce8918'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.735162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] The token cache is being invalidate because project 371ee3d385e0484db19eb9102133598c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:03.735628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.736397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-747c9e48-0835-42b1-8e97-38cad8ce8918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:03.744782 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1040/2063] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:03 2021] DELETE /identity/v3/projects/371ee3d385e0484db19eb9102133598c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:03.744782 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376850f-57a1-4a98-8925-64cf057bfa7d None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.744782 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376850f-57a1-4a98-8925-64cf057bfa7d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.744782 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376850f-57a1-4a98-8925-64cf057bfa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.762581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1024/2064] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:03.767285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf57b0-9194-4f2f-bfa4-2a00fe58bfed None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.767729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf57b0-9194-4f2f-bfa4-2a00fe58bfed None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.768130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf57b0-9194-4f2f-bfa4-2a00fe58bfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.791532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-4376850f-57a1-4a98-8925-64cf057bfa7d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:03.792869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4376850f-57a1-4a98-8925-64cf057bfa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.801492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-31bf57b0-9194-4f2f-bfa4-2a00fe58bfed None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:03.803256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-31bf57b0-9194-4f2f-bfa4-2a00fe58bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.805527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1041/2065] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:03.806635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376850f-57a1-4a98-8925-64cf057bfa7d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:03.812769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1025/2066] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:03.813849 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf57b0-9194-4f2f-bfa4-2a00fe58bfed None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:03.820311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376850f-57a1-4a98-8925-64cf057bfa7d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:03.828750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:03.829282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf57b0-9194-4f2f-bfa4-2a00fe58bfed None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:03.831467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.832741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.833532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.833929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f76ed-e6ab-4617-9156-8b2388b30e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:03.834592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f76ed-e6ab-4617-9156-8b2388b30e1d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.834885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f76ed-e6ab-4617-9156-8b2388b30e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.835285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f76ed-e6ab-4617-9156-8b2388b30e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.836779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f76ed-e6ab-4617-9156-8b2388b30e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:03.837068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f76ed-e6ab-4617-9156-8b2388b30e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:03.838075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:03.838977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:03.839378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f76ed-e6ab-4617-9156-8b2388b30e1d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:03.843701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:03.855337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1026/2067] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:03.856861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc537a-9514-4aa1-bada-93e55430e35e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.857157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc537a-9514-4aa1-bada-93e55430e35e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.857949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc537a-9514-4aa1-bada-93e55430e35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.882235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1042/2068] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:03.883769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-dfdc537a-9514-4aa1-bada-93e55430e35e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:03.884356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:03.885110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-dfdc537a-9514-4aa1-bada-93e55430e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:03.905757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1027/2069] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:03.907776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc537a-9514-4aa1-bada-93e55430e35e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:03.937945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9514c-2aeb-4cbc-b34d-f0615308f807 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:03.947530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc738f3-f2b6-44c5-b46b-bcba738c5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:03.949134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc738f3-f2b6-44c5-b46b-bcba738c5e7f admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.950074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc738f3-f2b6-44c5-b46b-bcba738c5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.952106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc537a-9514-4aa1-bada-93e55430e35e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:03.958785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc738f3-f2b6-44c5-b46b-bcba738c5e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.959778 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc738f3-f2b6-44c5-b46b-bcba738c5e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:03.962557 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc738f3-f2b6-44c5-b46b-bcba738c5e7f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:03.985048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbb0cb-a0f0-43f6-9109-2b848ce27669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:03.986488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbb0cb-a0f0-43f6-9109-2b848ce27669 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:03.987386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbb0cb-a0f0-43f6-9109-2b848ce27669 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:03.987928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbb0cb-a0f0-43f6-9109-2b848ce27669 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:03.989277 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbb0cb-a0f0-43f6-9109-2b848ce27669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:03.994451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbb0cb-a0f0-43f6-9109-2b848ce27669 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.004591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1043/2070] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:03 2021] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:04.005510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc738f3-f2b6-44c5-b46b-bcba738c5e7f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.072812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1028/2071] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:03 2021] POST /identity/v3/projects => generated 355 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:04.073959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbb0cb-a0f0-43f6-9109-2b848ce27669 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.192219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc738f3-f2b6-44c5-b46b-bcba738c5e7f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.198900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbb0cb-a0f0-43f6-9109-2b848ce27669 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.200064 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.202741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.202741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.202741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.202741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:04.202741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.204335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.231995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1044/2072] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:04.233276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.239197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ff83-e3cf-4c98-9d86-805e63f08a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.240920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ff83-e3cf-4c98-9d86-805e63f08a0d admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.241081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ff83-e3cf-4c98-9d86-805e63f08a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.241771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ff83-e3cf-4c98-9d86-805e63f08a0d admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.243379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1ff83-e3cf-4c98-9d86-805e63f08a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.251538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1ff83-e3cf-4c98-9d86-805e63f08a0d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.269813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12004c-6ca4-4390-b2ff-e2d3e95d8219 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.316273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1029/2073] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:04 2021] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:04.317367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ff83-e3cf-4c98-9d86-805e63f08a0d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.321443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00a896-6e37-45ad-87cd-7311656a3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.322507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00a896-6e37-45ad-87cd-7311656a3bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.323000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00a896-6e37-45ad-87cd-7311656a3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.323477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00a896-6e37-45ad-87cd-7311656a3bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.340887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ff83-e3cf-4c98-9d86-805e63f08a0d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.349384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00a896-6e37-45ad-87cd-7311656a3bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.352197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.352948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.353371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.353759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.354562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.356677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.359910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00a896-6e37-45ad-87cd-7311656a3bc7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.400718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1030/2074] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:04 2021] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:04.402649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.405326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:04.409025 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1045/2075] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:04 2021] POST /identity/v3/users => generated 278 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:04.410509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00a896-6e37-45ad-87cd-7311656a3bc7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.427741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00a896-6e37-45ad-87cd-7311656a3bc7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.579087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726090e-da01-4f6f-8e62-7e13cfb9ef00 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.588486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.589958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.590518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.591061 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] PATH_INFO: `/v3/projects/da0f13f97f4b48e2b4e3d6b2d020fbb3` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.593229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0f13f97f4b48e2b4e3d6b2d020fbb3)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.596543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17571d-e6e3-4bc0-ba10-8f669943688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.597411 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17571d-e6e3-4bc0-ba10-8f669943688d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.599671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.600585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17571d-e6e3-4bc0-ba10-8f669943688d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.601365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17571d-e6e3-4bc0-ba10-8f669943688d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.611494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17571d-e6e3-4bc0-ba10-8f669943688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.613528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17571d-e6e3-4bc0-ba10-8f669943688d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.636200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1046/2076] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:04 2021] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:04.636200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17571d-e6e3-4bc0-ba10-8f669943688d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.678326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17571d-e6e3-4bc0-ba10-8f669943688d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.696854 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d974-591f-4d24-94cf-a60c886bf68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.702328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d974-591f-4d24-94cf-a60c886bf68a admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.702775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d974-591f-4d24-94cf-a60c886bf68a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.706044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d974-591f-4d24-94cf-a60c886bf68a admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.707663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1d974-591f-4d24-94cf-a60c886bf68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.712254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1d974-591f-4d24-94cf-a60c886bf68a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.740081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0f13f97f4b48e2b4e3d6b2d020fbb3', 'request_id': 'req-ae6a1201-20f0-4a65-9abf-63422d95a29b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:04.749477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0f13f97f4b48e2b4e3d6b2d020fbb3', 'request_id': 'req-ae6a1201-20f0-4a65-9abf-63422d95a29b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:04.761837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1047/2077] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:04 2021] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:04.764364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d974-591f-4d24-94cf-a60c886bf68a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.775573 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0f13f97f4b48e2b4e3d6b2d020fbb3', 'request_id': 'req-ae6a1201-20f0-4a65-9abf-63422d95a29b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:04.803628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d974-591f-4d24-94cf-a60c886bf68a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.805790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] The token cache is being invalidate because project da0f13f97f4b48e2b4e3d6b2d020fbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:04.806090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:04.807218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:04.814204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1031/2078] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:04 2021] DELETE /identity/v3/projects/da0f13f97f4b48e2b4e3d6b2d020fbb3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:04.815339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:04.817556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:04.984862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a1201-20f0-4a65-9abf-63422d95a29b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:04.986753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856c17a-d17f-4716-adaf-d176fa826b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.987522 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856c17a-d17f-4716-adaf-d176fa826b67 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.987974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856c17a-d17f-4716-adaf-d176fa826b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.988268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856c17a-d17f-4716-adaf-d176fa826b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.988985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856c17a-d17f-4716-adaf-d176fa826b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.990643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856c17a-d17f-4716-adaf-d176fa826b67 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:04.992351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:04.993177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:04.993628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:04.994064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:04.995303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:04.997431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.012608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1032/2079] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:04 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:05.013993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.016516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:05.020866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1048/2080] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:04 2021] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:05.025713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054dd6-8a02-4a5e-8ba8-c82985f4ca0d None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.026009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054dd6-8a02-4a5e-8ba8-c82985f4ca0d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.026383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054dd6-8a02-4a5e-8ba8-c82985f4ca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.034553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71ee66-2d82-42f0-b038-41e8843f79d5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.040878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301f969-3e10-48e7-8a4d-18fcfb856740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.041751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f969-3e10-48e7-8a4d-18fcfb856740 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.041934 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f969-3e10-48e7-8a4d-18fcfb856740 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.042163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f969-3e10-48e7-8a4d-18fcfb856740 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.043083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301f969-3e10-48e7-8a4d-18fcfb856740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.044710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301f969-3e10-48e7-8a4d-18fcfb856740 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.063522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1033/2081] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:05.063522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301f969-3e10-48e7-8a4d-18fcfb856740 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.078644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301f969-3e10-48e7-8a4d-18fcfb856740 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.080607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-d0054dd6-8a02-4a5e-8ba8-c82985f4ca0d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:05.081948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d0054dd6-8a02-4a5e-8ba8-c82985f4ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:05.084529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608e749-9139-4d06-8a30-72ec0b45f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.085640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e749-9139-4d06-8a30-72ec0b45f0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.086141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e749-9139-4d06-8a30-72ec0b45f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.086569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e749-9139-4d06-8a30-72ec0b45f0ac admin admin] PATH_INFO: `/v3/projects/4cfa8f0b93c549c8b0e7f02d81d843fb/users/21bf9f1bb8444a9da6e3bd648cf5a5cc/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.092623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1049/2082] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:05.093917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0054dd6-8a02-4a5e-8ba8-c82985f4ca0d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.095530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d0054dd6-8a02-4a5e-8ba8-c82985f4ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:05.112006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0054dd6-8a02-4a5e-8ba8-c82985f4ca0d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.118228 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa97d27-0832-42e2-899a-0d0fd83dd1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.119055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa97d27-0832-42e2-899a-0d0fd83dd1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.119599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa97d27-0832-42e2-899a-0d0fd83dd1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.119965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa97d27-0832-42e2-899a-0d0fd83dd1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.120596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608e749-9139-4d06-8a30-72ec0b45f0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfa8f0b93c549c8b0e7f02d81d843fb, user_id=21bf9f1bb8444a9da6e3bd648cf5a5cc, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.121143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa97d27-0832-42e2-899a-0d0fd83dd1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.122923 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa97d27-0832-42e2-899a-0d0fd83dd1c7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.123569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608e749-9139-4d06-8a30-72ec0b45f0ac admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.142908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1050/2084] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:05.143936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa97d27-0832-42e2-899a-0d0fd83dd1c7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.152864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1034/2084] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:05 2021] PUT /identity/v3/projects/4cfa8f0b93c549c8b0e7f02d81d843fb/users/21bf9f1bb8444a9da6e3bd648cf5a5cc/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:05.154619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5612f-0af7-4a05-83a9-eac5af0bf0f2 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.154953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5612f-0af7-4a05-83a9-eac5af0bf0f2 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.155310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5612f-0af7-4a05-83a9-eac5af0bf0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.157841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa97d27-0832-42e2-899a-0d0fd83dd1c7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.181307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-b7f5612f-0af7-4a05-83a9-eac5af0bf0f2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:05.182654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b7f5612f-0af7-4a05-83a9-eac5af0bf0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:05.250154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fd949-1dec-487b-bade-4a83ca0c8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.250807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd949-1dec-487b-bade-4a83ca0c8905 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.251027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd949-1dec-487b-bade-4a83ca0c8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.251312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd949-1dec-487b-bade-4a83ca0c8905 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.255350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fd949-1dec-487b-bade-4a83ca0c8905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.259610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fd949-1dec-487b-bade-4a83ca0c8905 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.261908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1035/2085] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:05.262911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5612f-0af7-4a05-83a9-eac5af0bf0f2 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.273733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5612f-0af7-4a05-83a9-eac5af0bf0f2 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.280216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678079df-fd6a-4ef2-add5-01f3c8805450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.281057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678079df-fd6a-4ef2-add5-01f3c8805450 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.281400 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678079df-fd6a-4ef2-add5-01f3c8805450 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.281634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678079df-fd6a-4ef2-add5-01f3c8805450 admin admin] PATH_INFO: `/v3/projects/e437817badd741439f95dd0a48547060/users/8da7c843b5664dbfb8ac19d850e6c86b/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.291291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1051/2086] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:05.295706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1205b-cf57-4f67-a508-be12417584f6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.296519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1205b-cf57-4f67-a508-be12417584f6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.297401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1205b-cf57-4f67-a508-be12417584f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.305338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678079df-fd6a-4ef2-add5-01f3c8805450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e437817badd741439f95dd0a48547060, user_id=8da7c843b5664dbfb8ac19d850e6c86b, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.308423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678079df-fd6a-4ef2-add5-01f3c8805450 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.330395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1036/2087] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:05 2021] PUT /identity/v3/projects/e437817badd741439f95dd0a48547060/users/8da7c843b5664dbfb8ac19d850e6c86b/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:05.331974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678079df-fd6a-4ef2-add5-01f3c8805450 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.376807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7ab1205b-cf57-4f67-a508-be12417584f6 None None] MFA Rules not processed for user `21bf9f1bb8444a9da6e3bd648cf5a5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:05.379301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7ab1205b-cf57-4f67-a508-be12417584f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:05.492170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678079df-fd6a-4ef2-add5-01f3c8805450 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.501598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00aa15-dbcd-4e1a-8c4e-fde4a38f7d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.502556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00aa15-dbcd-4e1a-8c4e-fde4a38f7d33 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.503356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00aa15-dbcd-4e1a-8c4e-fde4a38f7d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.504268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00aa15-dbcd-4e1a-8c4e-fde4a38f7d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.505789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00aa15-dbcd-4e1a-8c4e-fde4a38f7d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:05.506356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00aa15-dbcd-4e1a-8c4e-fde4a38f7d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.510350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1052/2088] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:05 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:05.510350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1205b-cf57-4f67-a508-be12417584f6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.510895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00aa15-dbcd-4e1a-8c4e-fde4a38f7d33 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.528603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1205b-cf57-4f67-a508-be12417584f6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.542449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.542875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1037/2089] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:05.542875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1a656-8a4c-4664-9353-97b80a6484db None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.543175 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.543335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1a656-8a4c-4664-9353-97b80a6484db None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.543335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1a656-8a4c-4664-9353-97b80a6484db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.543652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.543652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] PATH_INFO: `/v3/projects/1bda41a63b28467cb60de8010e02c23d/users/70efd41a98c644ccab8b9de51b9454c1/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.569057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bda41a63b28467cb60de8010e02c23d, user_id=70efd41a98c644ccab8b9de51b9454c1, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.572329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.588242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-faa1a656-8a4c-4664-9353-97b80a6484db None None] MFA Rules not processed for user `8da7c843b5664dbfb8ac19d850e6c86b`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:05.591016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-faa1a656-8a4c-4664-9353-97b80a6484db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:05.608332 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1053/2090] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:05 2021] PUT /identity/v3/projects/1bda41a63b28467cb60de8010e02c23d/users/70efd41a98c644ccab8b9de51b9454c1/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:05.610952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.615552 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:05.717910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd18a7-dc00-4580-bba4-26a0774c2e99 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.724825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765bd60-ffd6-4f26-ad5b-0e8eedec88a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.726575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765bd60-ffd6-4f26-ad5b-0e8eedec88a1 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.727416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765bd60-ffd6-4f26-ad5b-0e8eedec88a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.728041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765bd60-ffd6-4f26-ad5b-0e8eedec88a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.728202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1038/2091] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:05 2021] POST /identity/v3/auth/tokens => generated 3662 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:05.728899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1a656-8a4c-4664-9353-97b80a6484db None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.825079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1a656-8a4c-4664-9353-97b80a6484db None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:05.838713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e75fd-69da-4a8a-beb0-ce482db5a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:05.839680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e75fd-69da-4a8a-beb0-ce482db5a89c admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.841346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e75fd-69da-4a8a-beb0-ce482db5a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.841838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e75fd-69da-4a8a-beb0-ce482db5a89c admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.844706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e75fd-69da-4a8a-beb0-ce482db5a89c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.846922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e75fd-69da-4a8a-beb0-ce482db5a89c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.887865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765bd60-ffd6-4f26-ad5b-0e8eedec88a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:05.890127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765bd60-ffd6-4f26-ad5b-0e8eedec88a1 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:05.909187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1039/2092] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:05 2021] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:05.916445 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c3b8-0900-4dfc-a76c-fae4c8bd28d7 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:05.916851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c3b8-0900-4dfc-a76c-fae4c8bd28d7 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:05.917284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c3b8-0900-4dfc-a76c-fae4c8bd28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:05.924507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1054/2093] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:05 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:05.925984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765bd60-ffd6-4f26-ad5b-0e8eedec88a1 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:05.982842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765bd60-ffd6-4f26-ad5b-0e8eedec88a1 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.020449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0cd4c3b8-0900-4dfc-a76c-fae4c8bd28d7 None None] MFA Rules not processed for user `70efd41a98c644ccab8b9de51b9454c1`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:06.021688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0cd4c3b8-0900-4dfc-a76c-fae4c8bd28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:06.096758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e992-f864-4ba3-bc55-4e04ed13e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.097613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e992-f864-4ba3-bc55-4e04ed13e3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.097937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e992-f864-4ba3-bc55-4e04ed13e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.098318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e992-f864-4ba3-bc55-4e04ed13e3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.099739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e992-f864-4ba3-bc55-4e04ed13e3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.102203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e992-f864-4ba3-bc55-4e04ed13e3b2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.140358 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1055/2094] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:05 2021] POST /identity/v3/projects => generated 357 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:06.143174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e992-f864-4ba3-bc55-4e04ed13e3b2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.218638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1040/2095] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:05 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:06.220734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c3b8-0900-4dfc-a76c-fae4c8bd28d7 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.234027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c3b8-0900-4dfc-a76c-fae4c8bd28d7 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.275943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e992-f864-4ba3-bc55-4e04ed13e3b2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.286289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b63818-2c7d-4304-9dde-90582e6c3485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.287297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b63818-2c7d-4304-9dde-90582e6c3485 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.287790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b63818-2c7d-4304-9dde-90582e6c3485 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.288348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b63818-2c7d-4304-9dde-90582e6c3485 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.289626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b63818-2c7d-4304-9dde-90582e6c3485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.293595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b63818-2c7d-4304-9dde-90582e6c3485 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.337282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.339280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.339751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.340572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] PATH_INFO: `/v3/users/21bf9f1bb8444a9da6e3bd648cf5a5cc` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.341318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1056/2096] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:06 2021] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:06.342756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b63818-2c7d-4304-9dde-90582e6c3485 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.343827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bf9f1bb8444a9da6e3bd648cf5a5cc)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.349466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.362430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b63818-2c7d-4304-9dde-90582e6c3485 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.374849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0628c-2c80-4dbc-8cca-6770779557e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.375976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0628c-2c80-4dbc-8cca-6770779557e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.376350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0628c-2c80-4dbc-8cca-6770779557e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.376881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0628c-2c80-4dbc-8cca-6770779557e7 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.378222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0628c-2c80-4dbc-8cca-6770779557e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.381823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0628c-2c80-4dbc-8cca-6770779557e7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.424518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1057/2097] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:06 2021] POST /identity/v3/users => generated 285 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:06.426030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0628c-2c80-4dbc-8cca-6770779557e7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.435142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bf9f1bb8444a9da6e3bd648cf5a5cc'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:06.455374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bf9f1bb8444a9da6e3bd648cf5a5cc'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:06.457024 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bf9f1bb8444a9da6e3bd648cf5a5cc'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:06.458050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bf9f1bb8444a9da6e3bd648cf5a5cc'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:06.484798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bf9f1bb8444a9da6e3bd648cf5a5cc'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:06.527532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1041/2098] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:06 2021] DELETE /identity/v3/users/21bf9f1bb8444a9da6e3bd648cf5a5cc => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:06.528588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.530294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:06.535809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0628c-2c80-4dbc-8cca-6770779557e7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.649938 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a649-8b35-486e-8bff-0b239217a0ae admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.666477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.667702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.668165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.668626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.669827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.671834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.673244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.675297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.675783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.676213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.680538 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:06.697007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1042/2099] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:06.698637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.703930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:06.735541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdbc90-9c31-42c2-81bf-00bb84ac5e01 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.743470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c994fc7-182e-4a7e-a0c1-ce0c7b0dbef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.744114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c994fc7-182e-4a7e-a0c1-ce0c7b0dbef4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.744404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c994fc7-182e-4a7e-a0c1-ce0c7b0dbef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.744694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c994fc7-182e-4a7e-a0c1-ce0c7b0dbef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.745475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c994fc7-182e-4a7e-a0c1-ce0c7b0dbef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.749486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c994fc7-182e-4a7e-a0c1-ce0c7b0dbef4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.764081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1043/2100] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:06.765514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23c26-1d35-47bd-9d0f-4f471a46940c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.765813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23c26-1d35-47bd-9d0f-4f471a46940c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.766095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23c26-1d35-47bd-9d0f-4f471a46940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.792800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6be23c26-1d35-47bd-9d0f-4f471a46940c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:06.795099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6be23c26-1d35-47bd-9d0f-4f471a46940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:06.804697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1044/2101] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:06.805582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be23c26-1d35-47bd-9d0f-4f471a46940c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.831501 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be23c26-1d35-47bd-9d0f-4f471a46940c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.836966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ae73b-7812-4d79-be2d-4858b5d8e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.837583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ae73b-7812-4d79-be2d-4858b5d8e3ad admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.837877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ae73b-7812-4d79-be2d-4858b5d8e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.838163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ae73b-7812-4d79-be2d-4858b5d8e3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.839452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ae73b-7812-4d79-be2d-4858b5d8e3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.841095 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ae73b-7812-4d79-be2d-4858b5d8e3ad admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.859156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1045/2102] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:06.860145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ae73b-7812-4d79-be2d-4858b5d8e3ad admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.872217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ae73b-7812-4d79-be2d-4858b5d8e3ad admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:06.883124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921be0b-a249-4a7c-b529-a6c4442c80d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:06.883124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921be0b-a249-4a7c-b529-a6c4442c80d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:06.883124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921be0b-a249-4a7c-b529-a6c4442c80d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:06.883124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921be0b-a249-4a7c-b529-a6c4442c80d2 admin admin] PATH_INFO: `/v3/projects/0a37960012344d2ea5ecb793107493ee/users/5de69e50447848c7aca3c7e0a2d3ab83/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:06.893465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.895909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.906805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921be0b-a249-4a7c-b529-a6c4442c80d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a37960012344d2ea5ecb793107493ee, user_id=5de69e50447848c7aca3c7e0a2d3ab83, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:06.909998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921be0b-a249-4a7c-b529-a6c4442c80d2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:06.914111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1058/2103] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:06 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:06.915348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:06.917539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:06.941567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1046/2104] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:06 2021] PUT /identity/v3/projects/0a37960012344d2ea5ecb793107493ee/users/5de69e50447848c7aca3c7e0a2d3ab83/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:06.941567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921be0b-a249-4a7c-b529-a6c4442c80d2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:07.043884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa98274-91d2-48b1-9014-95e41896ca80 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:07.071354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921be0b-a249-4a7c-b529-a6c4442c80d2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:07.076713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5c150-4362-464c-8e16-08a223fde22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:07.077723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c150-4362-464c-8e16-08a223fde22f admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:07.078115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c150-4362-464c-8e16-08a223fde22f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:07.079031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c150-4362-464c-8e16-08a223fde22f admin admin] PATH_INFO: `/v3/projects/a3a276bf00094bb6980b5b033de7414f/users/d5d4347d287d42758c41dd6e9dfc171d/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:07.102077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5c150-4362-464c-8e16-08a223fde22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a276bf00094bb6980b5b033de7414f, user_id=d5d4347d287d42758c41dd6e9dfc171d, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:07.105025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5c150-4362-464c-8e16-08a223fde22f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:07.116597 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45510aa-0801-4291-affc-e686932eb915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:07.117523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45510aa-0801-4291-affc-e686932eb915 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:07.118035 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45510aa-0801-4291-affc-e686932eb915 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:07.118325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45510aa-0801-4291-affc-e686932eb915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:07.133264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1047/2105] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:06 2021] PUT /identity/v3/projects/a3a276bf00094bb6980b5b033de7414f/users/d5d4347d287d42758c41dd6e9dfc171d/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:07.134301 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5c150-4362-464c-8e16-08a223fde22f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:07.136583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45510aa-0801-4291-affc-e686932eb915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:07.139790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45510aa-0801-4291-affc-e686932eb915 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:07.162498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1059/2106] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:07.165453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c7e0-64d2-4778-8ac2-629a3db56a30 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:07.166096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c7e0-64d2-4778-8ac2-629a3db56a30 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:07.166607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c7e0-64d2-4778-8ac2-629a3db56a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:07.248562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-be87c7e0-64d2-4778-8ac2-629a3db56a30 None None] MFA Rules not processed for user `d5d4347d287d42758c41dd6e9dfc171d`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:07.251376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-be87c7e0-64d2-4778-8ac2-629a3db56a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:07.265357 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5c150-4362-464c-8e16-08a223fde22f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:07.279570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee92c9-2570-4c29-b1cc-5d057cf6134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:07.280343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee92c9-2570-4c29-b1cc-5d057cf6134b admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:07.280632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee92c9-2570-4c29-b1cc-5d057cf6134b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:07.282143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee92c9-2570-4c29-b1cc-5d057cf6134b admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:07.283630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee92c9-2570-4c29-b1cc-5d057cf6134b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:07.287226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee92c9-2570-4c29-b1cc-5d057cf6134b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:07.314815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1048/2107] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:07 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:07.319814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee92c9-2570-4c29-b1cc-5d057cf6134b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:07.342381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee92c9-2570-4c29-b1cc-5d057cf6134b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:07.353483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05faaa-a7af-44cf-b9be-b5ffad2cae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:07.354330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05faaa-a7af-44cf-b9be-b5ffad2cae36 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:07.354904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05faaa-a7af-44cf-b9be-b5ffad2cae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:07.355196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05faaa-a7af-44cf-b9be-b5ffad2cae36 admin admin] PATH_INFO: `/v3/projects/0a37960012344d2ea5ecb793107493ee/users/5de69e50447848c7aca3c7e0a2d3ab83/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:07.360858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05faaa-a7af-44cf-b9be-b5ffad2cae36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a37960012344d2ea5ecb793107493ee, user_id=5de69e50447848c7aca3c7e0a2d3ab83, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:07.364045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05faaa-a7af-44cf-b9be-b5ffad2cae36 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:07.399687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1049/2108] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:07 2021] PUT /identity/v3/projects/0a37960012344d2ea5ecb793107493ee/users/5de69e50447848c7aca3c7e0a2d3ab83/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:07.419991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7d2a-7c0f-44b9-9c93-29844c7b156b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:07.420586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7d2a-7c0f-44b9-9c93-29844c7b156b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:07.421226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7d2a-7c0f-44b9-9c93-29844c7b156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:07.503657 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1060/2109] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:07 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:07.509214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c7e0-64d2-4778-8ac2-629a3db56a30 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:07.526373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c7e0-64d2-4778-8ac2-629a3db56a30 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:07.576143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-bf3b7d2a-7c0f-44b9-9c93-29844c7b156b None None] MFA Rules not processed for user `5de69e50447848c7aca3c7e0a2d3ab83`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:07.578786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bf3b7d2a-7c0f-44b9-9c93-29844c7b156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:07.640163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074256e-f4e3-4086-9ffe-52ba7d69c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:07.640889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074256e-f4e3-4086-9ffe-52ba7d69c4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:07.641280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074256e-f4e3-4086-9ffe-52ba7d69c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:07.641661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074256e-f4e3-4086-9ffe-52ba7d69c4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:07.642447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074256e-f4e3-4086-9ffe-52ba7d69c4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:07.645165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074256e-f4e3-4086-9ffe-52ba7d69c4d8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:07.690453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1061/2110] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:07 2021] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:07.695165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074256e-f4e3-4086-9ffe-52ba7d69c4d8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:07.937009 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074256e-f4e3-4086-9ffe-52ba7d69c4d8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:07.951245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:07.951875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:07.952166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:07.952449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:07.953114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:07.955164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:07.984571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1050/2111] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:07 2021] POST /identity/v3/auth/tokens => generated 3731 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:08.011637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1062/2112] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:07 2021] POST /identity/v3/users => generated 300 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:08.013816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7d2a-7c0f-44b9-9c93-29844c7b156b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:08.044142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7d2a-7c0f-44b9-9c93-29844c7b156b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:08.051427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:08.053616 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:08.066259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4e28-f01b-4531-8ed4-08ffc3c71ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:08.067349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4e28-f01b-4531-8ed4-08ffc3c71ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.067881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4e28-f01b-4531-8ed4-08ffc3c71ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.068381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4e28-f01b-4531-8ed4-08ffc3c71ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.070200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed4e28-f01b-4531-8ed4-08ffc3c71ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:08.073356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed4e28-f01b-4531-8ed4-08ffc3c71ea5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:08.108643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1051/2113] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:08 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:08.111101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4e28-f01b-4531-8ed4-08ffc3c71ea5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:08.131966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4e28-f01b-4531-8ed4-08ffc3c71ea5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:08.141078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:08.142371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.142808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.143271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] PATH_INFO: `/v3/projects/aae53968e9444b7eab9640f029a6b6c2/users/590566f243804281944537a8435c6511/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.188189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae53968e9444b7eab9640f029a6b6c2, user_id=590566f243804281944537a8435c6511, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:08.191770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:08.208338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b257ce-a72b-4581-bb38-ccebd8ad2825 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:08.213954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1052/2114] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:08 2021] PUT /identity/v3/projects/aae53968e9444b7eab9640f029a6b6c2/users/590566f243804281944537a8435c6511/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:08.215908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:08.219953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:08.333851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504574-264f-4645-89f4-8deac84ae1e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:08.335157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504574-264f-4645-89f4-8deac84ae1e6 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.335652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504574-264f-4645-89f4-8deac84ae1e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.336573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504574-264f-4645-89f4-8deac84ae1e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.385914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fae16-1b3b-436f-beae-c61ad7d1edb9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:08.391218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:08.393739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.394045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.394468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] PATH_INFO: `/v3/projects/4cfa8f0b93c549c8b0e7f02d81d843fb` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.395952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfa8f0b93c549c8b0e7f02d81d843fb)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:08.397942 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:08.471558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504574-264f-4645-89f4-8deac84ae1e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:08.472769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504574-264f-4645-89f4-8deac84ae1e6 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:08.475163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfa8f0b93c549c8b0e7f02d81d843fb', 'request_id': 'req-c8941068-be18-42d8-9333-787dd37720fc'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:08.487822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfa8f0b93c549c8b0e7f02d81d843fb', 'request_id': 'req-c8941068-be18-42d8-9333-787dd37720fc'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:08.488675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1063/2115] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:08 2021] GET /identity/v3/auth/tokens => generated 3731 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:08.490249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504574-264f-4645-89f4-8deac84ae1e6 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:08.503304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfa8f0b93c549c8b0e7f02d81d843fb', 'request_id': 'req-c8941068-be18-42d8-9333-787dd37720fc'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:08.509847 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504574-264f-4645-89f4-8deac84ae1e6 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:08.541603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] The token cache is being invalidate because project 4cfa8f0b93c549c8b0e7f02d81d843fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:08.542316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:08.544137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c8941068-be18-42d8-9333-787dd37720fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:08.547051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1053/2116] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:08 2021] DELETE /identity/v3/projects/4cfa8f0b93c549c8b0e7f02d81d843fb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:08.561722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bf35-ccde-4198-bd6e-43bc107171ac None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.562121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bf35-ccde-4198-bd6e-43bc107171ac None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.562590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bf35-ccde-4198-bd6e-43bc107171ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.634654 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1a84bf35-ccde-4198-bd6e-43bc107171ac None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:08.636635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1a84bf35-ccde-4198-bd6e-43bc107171ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:08.667953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:08.668738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.669237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.669562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.670688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:08.672634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:08.687576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1064/2117] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:08 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:08.688539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:08.694927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:08.777164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1054/2118] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:08.790103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84bf35-ccde-4198-bd6e-43bc107171ac None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:08.792723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1a84bf35-ccde-4198-bd6e-43bc107171ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:08.815105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84bf35-ccde-4198-bd6e-43bc107171ac None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:08.817261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d55df9-96fd-4459-a9fc-0bb96a5a368c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:08.822101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:08.823145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.823511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.823657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dea50-4d91-4cbd-9241-fd8e68e91826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:08.823931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.825167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dea50-4d91-4cbd-9241-fd8e68e91826 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.825734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dea50-4d91-4cbd-9241-fd8e68e91826 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.826319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dea50-4d91-4cbd-9241-fd8e68e91826 admin admin] PATH_INFO: `/v3/projects/aae53968e9444b7eab9640f029a6b6c2/users/590566f243804281944537a8435c6511/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.826896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:08.830062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dea50-4d91-4cbd-9241-fd8e68e91826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae53968e9444b7eab9640f029a6b6c2, user_id=590566f243804281944537a8435c6511, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:08.836062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dea50-4d91-4cbd-9241-fd8e68e91826 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:08.857706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1055/2119] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:08 2021] PUT /identity/v3/projects/aae53968e9444b7eab9640f029a6b6c2/users/590566f243804281944537a8435c6511/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:08.860395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb47c-6762-4653-95da-f1473bf7201c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.861006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb47c-6762-4653-95da-f1473bf7201c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.861603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb47c-6762-4653-95da-f1473bf7201c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:08.898438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4bdeb47c-6762-4653-95da-f1473bf7201c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:08.899647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4bdeb47c-6762-4653-95da-f1473bf7201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:08.990567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1056/2120] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:08.993937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992d22-741a-4057-b22a-86eafca767a8 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:08.995859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992d22-741a-4057-b22a-86eafca767a8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:08.996593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992d22-741a-4057-b22a-86eafca767a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:09.008065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:09.010882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:09.029867 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1065/2121] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:08 2021] GET /identity/v3/auth/tokens => generated 3662 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:09.031469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:09.048745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-06992d22-741a-4057-b22a-86eafca767a8 None None] MFA Rules not processed for user `590566f243804281944537a8435c6511`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:09.048745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-06992d22-741a-4057-b22a-86eafca767a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:09.054384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905426d-01fc-4dce-a8d2-6b5e8214e4a2 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:09.063861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:09.065044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:09.065679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:09.066561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:09.068149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:09.068779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:09.072661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:09.099598 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1066/2122] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:09.105296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:09.128068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea0741-a869-48f2-9208-55d40377ae19 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:09.136917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e7d98-f098-4c6f-b5d2-e1eafa175531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:09.137537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e7d98-f098-4c6f-b5d2-e1eafa175531 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:09.141131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e7d98-f098-4c6f-b5d2-e1eafa175531 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:09.141491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e7d98-f098-4c6f-b5d2-e1eafa175531 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:09.142209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e7d98-f098-4c6f-b5d2-e1eafa175531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:09.145249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e7d98-f098-4c6f-b5d2-e1eafa175531 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:09.194040 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1067/2123] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:09 2021] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:09.195777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e7d98-f098-4c6f-b5d2-e1eafa175531 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:09.300280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1057/2124] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:08 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:09.302829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a7ac7-abde-436c-84d2-48589d7b3529 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:09.303310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a7ac7-abde-436c-84d2-48589d7b3529 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:09.303802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a7ac7-abde-436c-84d2-48589d7b3529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:09.365875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e7d98-f098-4c6f-b5d2-e1eafa175531 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:09.371635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de620-27c1-4acd-bd90-6bb5c189bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:09.372275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de620-27c1-4acd-bd90-6bb5c189bda4 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:09.372564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de620-27c1-4acd-bd90-6bb5c189bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:09.372846 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de620-27c1-4acd-bd90-6bb5c189bda4 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:09.379264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2de620-27c1-4acd-bd90-6bb5c189bda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:09.381522 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2de620-27c1-4acd-bd90-6bb5c189bda4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:09.411692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a87a7ac7-abde-436c-84d2-48589d7b3529 None None] MFA Rules not processed for user `70efd41a98c644ccab8b9de51b9454c1`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:09.415945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a87a7ac7-abde-436c-84d2-48589d7b3529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:09.430326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1068/2125] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:09 2021] POST /identity/v3/users => generated 282 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:09.431319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de620-27c1-4acd-bd90-6bb5c189bda4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:09.650595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de620-27c1-4acd-bd90-6bb5c189bda4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:09.661659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058474b-410c-4b11-aabc-35e455d7332d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:09.663442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058474b-410c-4b11-aabc-35e455d7332d service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:09.664618 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058474b-410c-4b11-aabc-35e455d7332d service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:09.665219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058474b-410c-4b11-aabc-35e455d7332d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:09.703886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1058/2126] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:09 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:09.705775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a7ac7-abde-436c-84d2-48589d7b3529 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:09.741075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a7ac7-abde-436c-84d2-48589d7b3529 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:09.763546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40172846-6371-413a-9a98-dca9b07fa830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:09.764921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40172846-6371-413a-9a98-dca9b07fa830 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:09.765506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40172846-6371-413a-9a98-dca9b07fa830 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:09.766131 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40172846-6371-413a-9a98-dca9b07fa830 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:09.769816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40172846-6371-413a-9a98-dca9b07fa830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:09.776459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40172846-6371-413a-9a98-dca9b07fa830 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:09.828440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1059/2127] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:09 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:09.830780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40172846-6371-413a-9a98-dca9b07fa830 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:09.876104 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40172846-6371-413a-9a98-dca9b07fa830 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:09.899544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c148e-3284-43bf-b25f-91745402f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:09.900575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c148e-3284-43bf-b25f-91745402f68f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:09.911690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c148e-3284-43bf-b25f-91745402f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:09.912193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c148e-3284-43bf-b25f-91745402f68f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:09.913610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c148e-3284-43bf-b25f-91745402f68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:09.916734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c148e-3284-43bf-b25f-91745402f68f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:09.962898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1060/2128] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:09 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:09.967502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058474b-410c-4b11-aabc-35e455d7332d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:09.970729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c148e-3284-43bf-b25f-91745402f68f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:09.975828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058474b-410c-4b11-aabc-35e455d7332d service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:10.008463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c148e-3284-43bf-b25f-91745402f68f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:10.017945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1069/2129] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:09 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:10.045345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:10.046764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:10.047230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:10.047708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] PATH_INFO: `/v3/projects/be666016093847b8adadfcf1ab24f08e/users/0ac06befaeef4e959f7872446d776ca6/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:10.089960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be666016093847b8adadfcf1ab24f08e, user_id=0ac06befaeef4e959f7872446d776ca6, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:10.095959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:10.128996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1061/2130] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:09 2021] PUT /identity/v3/projects/be666016093847b8adadfcf1ab24f08e/users/0ac06befaeef4e959f7872446d776ca6/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:10.154600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49f204-9684-4d96-a674-2a2c8730c7f4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:10.155087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49f204-9684-4d96-a674-2a2c8730c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:10.155903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49f204-9684-4d96-a674-2a2c8730c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:10.249891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-da49f204-9684-4d96-a674-2a2c8730c7f4 None None] MFA Rules not processed for user `0ac06befaeef4e959f7872446d776ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:10.251855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-da49f204-9684-4d96-a674-2a2c8730c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:10.406531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1070/2131] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:10 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:10.430927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:10.430927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:10.519786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f196cf-48b6-4ab1-a03d-62892f6d72d3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:10.523521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957c06-af3c-46c0-b0ee-57a4c015b517 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92f456ee8cf4564aaca2b16f320b49d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:10.524124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957c06-af3c-46c0-b0ee-57a4c015b517 service glance] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:10.524411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957c06-af3c-46c0-b0ee-57a4c015b517 service glance] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:10.524693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957c06-af3c-46c0-b0ee-57a4c015b517 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:10.535584 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957c06-af3c-46c0-b0ee-57a4c015b517 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:10.537049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957c06-af3c-46c0-b0ee-57a4c015b517 service glance] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:10.560175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1062/2132] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:10 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:12.653329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49f204-9684-4d96-a674-2a2c8730c7f4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:12.832553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49f204-9684-4d96-a674-2a2c8730c7f4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:12.838296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:12.839398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:12.839742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:12.840155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] PATH_INFO: `/v3/users/d5d4347d287d42758c41dd6e9dfc171d` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:12.842036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d4347d287d42758c41dd6e9dfc171d)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:12.844380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:12.917379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d4347d287d42758c41dd6e9dfc171d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:12.939214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d4347d287d42758c41dd6e9dfc171d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:12.940717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d4347d287d42758c41dd6e9dfc171d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:12.942493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d4347d287d42758c41dd6e9dfc171d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:12.974741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d4347d287d42758c41dd6e9dfc171d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:13.008757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1071/2133] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:12 2021] DELETE /identity/v3/users/d5d4347d287d42758c41dd6e9dfc171d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:13.011723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e482-7873-45a0-babf-4f833fbb3a05 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:13.012705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e482-7873-45a0-babf-4f833fbb3a05 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:13.013264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e482-7873-45a0-babf-4f833fbb3a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:13.109373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-9bf6e482-7873-45a0-babf-4f833fbb3a05 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:13.111158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9bf6e482-7873-45a0-babf-4f833fbb3a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:13.217836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1063/2134] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:13.229797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:13.231257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:13.341461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f40c-adf0-46e0-b120-28b27aae3660 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:13.345704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:13.346607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:13.346952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:13.347289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:13.357995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:13.359489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:13.369694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1072/2135] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:14.014707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6e482-7873-45a0-babf-4f833fbb3a05 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:14.017790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9bf6e482-7873-45a0-babf-4f833fbb3a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:14.078243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6e482-7873-45a0-babf-4f833fbb3a05 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:14.122981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:14.127897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:14.130471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:14.132570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] PATH_INFO: `/v3/projects/a3a276bf00094bb6980b5b033de7414f` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:14.138292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a276bf00094bb6980b5b033de7414f)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:14.145290 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:14.191842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:14.193583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:14.223196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2556f2e-e059-45f3-b8b8-3c96855e905e service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:14.238091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:14.239116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:14.239553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:14.240000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] PATH_INFO: `/v3/users/335796f0c1f84f528a0b6079a0ee3775` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:14.241206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=335796f0c1f84f528a0b6079a0ee3775)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:14.243950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:14.336665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335796f0c1f84f528a0b6079a0ee3775'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.338491 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a276bf00094bb6980b5b033de7414f', 'request_id': 'req-e3809870-341f-4f42-b5b7-885ee9337fbd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.345672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a276bf00094bb6980b5b033de7414f', 'request_id': 'req-e3809870-341f-4f42-b5b7-885ee9337fbd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.349235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335796f0c1f84f528a0b6079a0ee3775'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.350212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335796f0c1f84f528a0b6079a0ee3775'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.352560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335796f0c1f84f528a0b6079a0ee3775'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.357750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a276bf00094bb6980b5b033de7414f', 'request_id': 'req-e3809870-341f-4f42-b5b7-885ee9337fbd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.376330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-041042c3-bc66-4735-bd44-1c5da514c8ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335796f0c1f84f528a0b6079a0ee3775'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.403268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] The token cache is being invalidate because project a3a276bf00094bb6980b5b033de7414f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:14.404355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1073/2136] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:14 2021] DELETE /identity/v3/users/335796f0c1f84f528a0b6079a0ee3775 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:14.404652 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.405791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.409022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1064/2137] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:14 2021] DELETE /identity/v3/projects/a3a276bf00094bb6980b5b033de7414f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:14.413790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e3b5d-eb20-4b6d-b33b-415975331cb4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:14.413790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e3b5d-eb20-4b6d-b33b-415975331cb4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:14.413790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e3b5d-eb20-4b6d-b33b-415975331cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:14.416430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:14.418953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:14.510864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-865e3b5d-eb20-4b6d-b33b-415975331cb4 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:14.510864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-865e3b5d-eb20-4b6d-b33b-415975331cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:14.628980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809870-341f-4f42-b5b7-885ee9337fbd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:14.635246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:14.635619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1074/2138] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:14.636507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:14.636936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:14.637360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] PATH_INFO: `/v3/users/590566f243804281944537a8435c6511` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:14.638885 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590566f243804281944537a8435c6511)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:14.641002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:14.659492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e3b5d-eb20-4b6d-b33b-415975331cb4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:14.663907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-865e3b5d-eb20-4b6d-b33b-415975331cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:14.724027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590566f243804281944537a8435c6511'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.737215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590566f243804281944537a8435c6511'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.739122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590566f243804281944537a8435c6511'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.741177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590566f243804281944537a8435c6511'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.764058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590566f243804281944537a8435c6511'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:14.801006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1065/2139] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:14 2021] DELETE /identity/v3/users/590566f243804281944537a8435c6511 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:14.870645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e3b5d-eb20-4b6d-b33b-415975331cb4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:15.089781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:15.091433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:15.091433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:15.093033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:15.097920 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:15.219331 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:15.220994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:15.258701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1075/2140] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:15.789507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:15.791817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:15.826535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feccc4c-321c-4efc-8125-6b109de98028 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:15.840922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:15.842324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:15.848699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:15.849115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] PATH_INFO: `/v3/projects/aae53968e9444b7eab9640f029a6b6c2` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:15.851075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae53968e9444b7eab9640f029a6b6c2)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:15.853743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:15.998901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae53968e9444b7eab9640f029a6b6c2', 'request_id': 'req-39e079cd-c185-453c-b444-8de18bba43ef'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.016029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae53968e9444b7eab9640f029a6b6c2', 'request_id': 'req-39e079cd-c185-453c-b444-8de18bba43ef'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.045203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae53968e9444b7eab9640f029a6b6c2', 'request_id': 'req-39e079cd-c185-453c-b444-8de18bba43ef'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.103796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] The token cache is being invalidate because project aae53968e9444b7eab9640f029a6b6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:16.103796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.104296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:16.104477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-39e079cd-c185-453c-b444-8de18bba43ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.104614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:16.105093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1066/2141] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:15 2021] DELETE /identity/v3/projects/aae53968e9444b7eab9640f029a6b6c2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:16.124069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa045f-bb5e-41f4-8be5-1c9da48a3f67 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:16.124757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa045f-bb5e-41f4-8be5-1c9da48a3f67 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:16.127340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa045f-bb5e-41f4-8be5-1c9da48a3f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:16.137857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742f34-3524-46af-8ef3-75eca71d1e82 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:16.185704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-54fa045f-bb5e-41f4-8be5-1c9da48a3f67 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:16.187792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-54fa045f-bb5e-41f4-8be5-1c9da48a3f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:16.332455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:16.334752 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:16.335576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:16.336289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] PATH_INFO: `/v3/projects/65f8b2bf0c6e4c1684ec07a4fd6e2030` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:16.340451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f8b2bf0c6e4c1684ec07a4fd6e2030)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:16.344723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:16.360750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1067/2142] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:16.360750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74cfa4-bf90-4ec7-ae2b-1e519c97e259 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:16.361219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74cfa4-bf90-4ec7-ae2b-1e519c97e259 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:16.361597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74cfa4-bf90-4ec7-ae2b-1e519c97e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:16.398774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7c74cfa4-bf90-4ec7-ae2b-1e519c97e259 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:16.401147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7c74cfa4-bf90-4ec7-ae2b-1e519c97e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:16.411677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1068/2143] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:16.423755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74cfa4-bf90-4ec7-ae2b-1e519c97e259 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:16.436888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74cfa4-bf90-4ec7-ae2b-1e519c97e259 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:16.456565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:16.461494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:16.466475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:16.466475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:16.466475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:16.466475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:16.466475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:16.486294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1069/2144] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:16.498944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:16.512367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc5cd2-bc39-4d2f-b553-4b06d4f9908c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:16.521796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f8b2bf0c6e4c1684ec07a4fd6e2030', 'request_id': 'req-d216bfb0-3f47-4f01-87a9-be746c453795'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.533994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f8b2bf0c6e4c1684ec07a4fd6e2030', 'request_id': 'req-d216bfb0-3f47-4f01-87a9-be746c453795'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.551581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f8b2bf0c6e4c1684ec07a4fd6e2030', 'request_id': 'req-d216bfb0-3f47-4f01-87a9-be746c453795'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.610321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] The token cache is being invalidate because project 65f8b2bf0c6e4c1684ec07a4fd6e2030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:16.611078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.612000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:16.614499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1076/2145] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:16 2021] DELETE /identity/v3/projects/65f8b2bf0c6e4c1684ec07a4fd6e2030 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:16.685423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84ed15-90f6-4b42-9671-1b2cbc16a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:16.686499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84ed15-90f6-4b42-9671-1b2cbc16a39f admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:16.687072 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84ed15-90f6-4b42-9671-1b2cbc16a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:16.687620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84ed15-90f6-4b42-9671-1b2cbc16a39f admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:16.688723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84ed15-90f6-4b42-9671-1b2cbc16a39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:16.691268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84ed15-90f6-4b42-9671-1b2cbc16a39f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:16.782453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1070/2146] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:16 2021] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:16.785016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:16.795747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:16.843317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216bfb0-3f47-4f01-87a9-be746c453795 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:17.005483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e3e5b-7ffe-4164-8e81-062a89003994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:17.006719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3e5b-7ffe-4164-8e81-062a89003994 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.007809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3e5b-7ffe-4164-8e81-062a89003994 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.008397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3e5b-7ffe-4164-8e81-062a89003994 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.009743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e3e5b-7ffe-4164-8e81-062a89003994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:17.013720 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e3e5b-7ffe-4164-8e81-062a89003994 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:17.051802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1077/2147] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:16 2021] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:17.056833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84ed15-90f6-4b42-9671-1b2cbc16a39f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:17.076943 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84ed15-90f6-4b42-9671-1b2cbc16a39f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:17.084940 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dac0e-1830-4c36-9007-674b061f7488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:17.086086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dac0e-1830-4c36-9007-674b061f7488 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.086725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dac0e-1830-4c36-9007-674b061f7488 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.087300 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dac0e-1830-4c36-9007-674b061f7488 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.088586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dac0e-1830-4c36-9007-674b061f7488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:17.092240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dac0e-1830-4c36-9007-674b061f7488 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:17.117427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1071/2148] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:17.122125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e3e5b-7ffe-4164-8e81-062a89003994 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:17.134910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e3e5b-7ffe-4164-8e81-062a89003994 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:17.141869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fe0a7-cfd0-4f28-a8a6-b9fd7fb11886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:17.142570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe0a7-cfd0-4f28-a8a6-b9fd7fb11886 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.142860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe0a7-cfd0-4f28-a8a6-b9fd7fb11886 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.143153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe0a7-cfd0-4f28-a8a6-b9fd7fb11886 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.143862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe0a7-cfd0-4f28-a8a6-b9fd7fb11886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:17.145544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe0a7-cfd0-4f28-a8a6-b9fd7fb11886 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:17.158670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1078/2149] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:59:17.161743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dac0e-1830-4c36-9007-674b061f7488 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:17.173324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dac0e-1830-4c36-9007-674b061f7488 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:17.179297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b5087-4f7d-465c-8663-b87878c9a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:17.180883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b5087-4f7d-465c-8663-b87878c9a9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.181245 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b5087-4f7d-465c-8663-b87878c9a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.184912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b5087-4f7d-465c-8663-b87878c9a9f9 admin admin] PATH_INFO: `/v3/projects/f0cc12fac57d41a0a0eb330b8cf7ff49/users/cbaa09df1537435dba81ad3d24617d25/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.207368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b5087-4f7d-465c-8663-b87878c9a9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cc12fac57d41a0a0eb330b8cf7ff49, user_id=cbaa09df1537435dba81ad3d24617d25, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:17.210365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b5087-4f7d-465c-8663-b87878c9a9f9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:17.228702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1072/2150] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:17 2021] PUT /identity/v3/projects/f0cc12fac57d41a0a0eb330b8cf7ff49/users/cbaa09df1537435dba81ad3d24617d25/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:17.239798 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f30b6-5d20-4050-85a7-97a54743622a None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.240176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f30b6-5d20-4050-85a7-97a54743622a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.240504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f30b6-5d20-4050-85a7-97a54743622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.283395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-fc7f30b6-5d20-4050-85a7-97a54743622a None None] MFA Rules not processed for user `cbaa09df1537435dba81ad3d24617d25`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:17.284766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fc7f30b6-5d20-4050-85a7-97a54743622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:17.391265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1079/2151] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:17 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:17.396229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b5087-4f7d-465c-8663-b87878c9a9f9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:17.480762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b5087-4f7d-465c-8663-b87878c9a9f9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:17.485688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f487a-8c20-4f7d-a3bb-530fc2fa4311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:17.486298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f487a-8c20-4f7d-a3bb-530fc2fa4311 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.486618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f487a-8c20-4f7d-a3bb-530fc2fa4311 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.487074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f487a-8c20-4f7d-a3bb-530fc2fa4311 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.488204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f487a-8c20-4f7d-a3bb-530fc2fa4311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:17.490676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f487a-8c20-4f7d-a3bb-530fc2fa4311 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:17.519806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1073/2152] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:17 2021] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:17.525123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f30b6-5d20-4050-85a7-97a54743622a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:17.537641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f30b6-5d20-4050-85a7-97a54743622a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:17.659511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7ae4-f862-4ee5-9b73-f90880b1c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:17.660783 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7ae4-f862-4ee5-9b73-f90880b1c876 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.661502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7ae4-f862-4ee5-9b73-f90880b1c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.662221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7ae4-f862-4ee5-9b73-f90880b1c876 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.664238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d7ae4-f862-4ee5-9b73-f90880b1c876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:17.668662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d7ae4-f862-4ee5-9b73-f90880b1c876 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:17.706907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1080/2153] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:17 2021] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:17.712751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f487a-8c20-4f7d-a3bb-530fc2fa4311 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:17.732022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f487a-8c20-4f7d-a3bb-530fc2fa4311 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:17.742242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1fb7d-ac7e-4eae-8e6c-2b2766724c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:17.743486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1fb7d-ac7e-4eae-8e6c-2b2766724c40 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.744007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1fb7d-ac7e-4eae-8e6c-2b2766724c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.744538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1fb7d-ac7e-4eae-8e6c-2b2766724c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.746191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1fb7d-ac7e-4eae-8e6c-2b2766724c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:17.749913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1fb7d-ac7e-4eae-8e6c-2b2766724c40 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:17.772352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1074/2154] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:17.780479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7ae4-f862-4ee5-9b73-f90880b1c876 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:17.795675 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7ae4-f862-4ee5-9b73-f90880b1c876 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:17.802157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faec620-076c-43f5-9c71-312e8d28265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:17.803236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec620-076c-43f5-9c71-312e8d28265c admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:17.803604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec620-076c-43f5-9c71-312e8d28265c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:17.803985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec620-076c-43f5-9c71-312e8d28265c admin admin] PATH_INFO: `/v3/projects/dfefa27414e948f3a7fb390f6b3de7e4/users/0881170257e54a37963549d703b54736/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:17.829725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faec620-076c-43f5-9c71-312e8d28265c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfefa27414e948f3a7fb390f6b3de7e4, user_id=0881170257e54a37963549d703b54736, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:17.832919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faec620-076c-43f5-9c71-312e8d28265c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:17.854721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1081/2155] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:17 2021] PUT /identity/v3/projects/dfefa27414e948f3a7fb390f6b3de7e4/users/0881170257e54a37963549d703b54736/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:17.860472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1fb7d-ac7e-4eae-8e6c-2b2766724c40 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:17.879582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1fb7d-ac7e-4eae-8e6c-2b2766724c40 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:18.029527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70115c-654f-4bb2-a844-abf49ff8edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:18.031201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70115c-654f-4bb2-a844-abf49ff8edd5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:18.031973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70115c-654f-4bb2-a844-abf49ff8edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:18.032611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70115c-654f-4bb2-a844-abf49ff8edd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:18.034224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70115c-654f-4bb2-a844-abf49ff8edd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:18.038691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70115c-654f-4bb2-a844-abf49ff8edd5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:18.062151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1075/2156] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:18.068634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faec620-076c-43f5-9c71-312e8d28265c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:18.087266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faec620-076c-43f5-9c71-312e8d28265c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:18.094983 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:18.096567 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:18.097148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:18.097750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] PATH_INFO: `/v3/projects/dfefa27414e948f3a7fb390f6b3de7e4/users/0881170257e54a37963549d703b54736/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:18.103333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfefa27414e948f3a7fb390f6b3de7e4, user_id=0881170257e54a37963549d703b54736, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:18.108943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:18.149815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1082/2157] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:18 2021] PUT /identity/v3/projects/dfefa27414e948f3a7fb390f6b3de7e4/users/0881170257e54a37963549d703b54736/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:18.161501 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56286832-cab1-4afb-8fda-dfafa010affc None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:18.162393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56286832-cab1-4afb-8fda-dfafa010affc None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:18.163105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56286832-cab1-4afb-8fda-dfafa010affc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:18.290880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-56286832-cab1-4afb-8fda-dfafa010affc None None] MFA Rules not processed for user `0881170257e54a37963549d703b54736`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:18.292148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-56286832-cab1-4afb-8fda-dfafa010affc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:18.528919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1076/2158] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:18 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:18.610503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:18.612569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:18.677863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbcb86-a99e-4689-9b05-d4184ec095ef None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:18.678471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbcb86-a99e-4689-9b05-d4184ec095ef None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:18.679033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbcb86-a99e-4689-9b05-d4184ec095ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:18.709007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-20fbcb86-a99e-4689-9b05-d4184ec095ef None None] MFA Rules not processed for user `9e0b49f365a542c080e2bdb043dc1387`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:18.711171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-20fbcb86-a99e-4689-9b05-d4184ec095ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:18.775988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe7355-18ad-4e7d-a833-e5f542f6c6de admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:18.792173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:18.792790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:18.793274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:18.793565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:18.895578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1077/2159] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:18 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:18.996853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:18.998164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:19.031545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1083/2160] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:18 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:25.517754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbcb86-a99e-4689-9b05-d4184ec095ef None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:25.535698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbcb86-a99e-4689-9b05-d4184ec095ef None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:25.552623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe62aef-0113-4273-a45e-3ac6544915ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:25.553678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe62aef-0113-4273-a45e-3ac6544915ed service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:25.554193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe62aef-0113-4273-a45e-3ac6544915ed service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:25.554834 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe62aef-0113-4273-a45e-3ac6544915ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:25.575739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe62aef-0113-4273-a45e-3ac6544915ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:25.577441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe62aef-0113-4273-a45e-3ac6544915ed service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:25.589331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1078/2161] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:25 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:59:31.769116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:31.772316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:31.941016 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e4186-5b08-4fbf-a29f-9d06d373f890 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:31.948837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:31.950360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:31.951005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:31.951586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] PATH_INFO: `/v3/users/8da7c843b5664dbfb8ac19d850e6c86b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:31.954029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da7c843b5664dbfb8ac19d850e6c86b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:31.958340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:32.039794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da7c843b5664dbfb8ac19d850e6c86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.048163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da7c843b5664dbfb8ac19d850e6c86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.048864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da7c843b5664dbfb8ac19d850e6c86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.049492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da7c843b5664dbfb8ac19d850e6c86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.064015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da7c843b5664dbfb8ac19d850e6c86b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.087245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1084/2162] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:31 2021] DELETE /identity/v3/users/8da7c843b5664dbfb8ac19d850e6c86b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:32.093634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35858ae-4359-47b7-9b98-34df7a159109 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:32.094672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35858ae-4359-47b7-9b98-34df7a159109 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:32.094912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35858ae-4359-47b7-9b98-34df7a159109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:32.130038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a35858ae-4359-47b7-9b98-34df7a159109 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:32.132750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a35858ae-4359-47b7-9b98-34df7a159109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:32.244498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1079/2163] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:32.259627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:32.261882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:32.493484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35858ae-4359-47b7-9b98-34df7a159109 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:32.495227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a35858ae-4359-47b7-9b98-34df7a159109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:32.516172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35858ae-4359-47b7-9b98-34df7a159109 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:32.531384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:32.538275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:32.538275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:32.538275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] PATH_INFO: `/v3/users/cbaa09df1537435dba81ad3d24617d25` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:32.540531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbaa09df1537435dba81ad3d24617d25)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:32.547118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:32.612399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974032d0-4345-4a3d-bb15-f1d938ce784b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:32.629014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94591b2f-4c01-40d4-8b53-e6385a12c2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:32.630565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591b2f-4c01-40d4-8b53-e6385a12c2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:32.631543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591b2f-4c01-40d4-8b53-e6385a12c2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:32.632512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591b2f-4c01-40d4-8b53-e6385a12c2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:32.655448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94591b2f-4c01-40d4-8b53-e6385a12c2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:32.658713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94591b2f-4c01-40d4-8b53-e6385a12c2a2 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:32.673768 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbaa09df1537435dba81ad3d24617d25'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.683052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1085/2164] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:32.689263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbaa09df1537435dba81ad3d24617d25'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.693953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbaa09df1537435dba81ad3d24617d25'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.693953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbaa09df1537435dba81ad3d24617d25'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.726376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbaa09df1537435dba81ad3d24617d25'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:32.786693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1080/2165] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:32 2021] DELETE /identity/v3/users/cbaa09df1537435dba81ad3d24617d25 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:32.798012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e536-5bce-41a5-93e1-f5383abeb781 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:32.801329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e536-5bce-41a5-93e1-f5383abeb781 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:32.802589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e536-5bce-41a5-93e1-f5383abeb781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:32.871048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-8922e536-5bce-41a5-93e1-f5383abeb781 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:32.874046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8922e536-5bce-41a5-93e1-f5383abeb781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:33.110087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1086/2166] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:33.127676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:33.130305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:33.347806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309f216-18f1-413f-86bd-34015d1bbba6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:33.365164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e306ae-d521-47f9-a12e-123e05758300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:33.366092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e306ae-d521-47f9-a12e-123e05758300 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:33.366432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e306ae-d521-47f9-a12e-123e05758300 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:33.366894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e306ae-d521-47f9-a12e-123e05758300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:33.404690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e306ae-d521-47f9-a12e-123e05758300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:33.409695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e306ae-d521-47f9-a12e-123e05758300 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:33.448521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1081/2167] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:59:33.544313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922e536-5bce-41a5-93e1-f5383abeb781 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:33.545747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8922e536-5bce-41a5-93e1-f5383abeb781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:33.557932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922e536-5bce-41a5-93e1-f5383abeb781 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:33.562665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:33.563492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:33.564364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:33.564718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] PATH_INFO: `/v3/projects/e437817badd741439f95dd0a48547060` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:33.565924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e437817badd741439f95dd0a48547060)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:33.568322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:33.678929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e437817badd741439f95dd0a48547060', 'request_id': 'req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.687117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e437817badd741439f95dd0a48547060', 'request_id': 'req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.697106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e437817badd741439f95dd0a48547060', 'request_id': 'req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.748518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] The token cache is being invalidate because project e437817badd741439f95dd0a48547060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:33.749234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.750577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.753871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1087/2168] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:33 2021] DELETE /identity/v3/projects/e437817badd741439f95dd0a48547060 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:33.759256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e306ae-d521-47f9-a12e-123e05758300 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:33.778504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e306ae-d521-47f9-a12e-123e05758300 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:33.883743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:33.884660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:33.884862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:33.885145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] PATH_INFO: `/v3/users/5de69e50447848c7aca3c7e0a2d3ab83` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:33.886342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de69e50447848c7aca3c7e0a2d3ab83)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:33.888322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:33.949514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de69e50447848c7aca3c7e0a2d3ab83'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.960270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de69e50447848c7aca3c7e0a2d3ab83'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.963580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de69e50447848c7aca3c7e0a2d3ab83'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.964362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de69e50447848c7aca3c7e0a2d3ab83'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:33.982800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de69e50447848c7aca3c7e0a2d3ab83'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:34.011002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1082/2169] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:33 2021] DELETE /identity/v3/users/5de69e50447848c7aca3c7e0a2d3ab83 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:34.399796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:34.402059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:34.427133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3652fc-aa16-465f-9a5a-4fefcf496ca5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:34.566160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:34.567802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:34.568429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:34.569015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] PATH_INFO: `/v3/projects/f0cc12fac57d41a0a0eb330b8cf7ff49` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:34.572876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0cc12fac57d41a0a0eb330b8cf7ff49)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:34.575877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:34.696985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0cc12fac57d41a0a0eb330b8cf7ff49', 'request_id': 'req-2d88cbf9-39f9-44d4-86d2-b6423f588093'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:34.710103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0cc12fac57d41a0a0eb330b8cf7ff49', 'request_id': 'req-2d88cbf9-39f9-44d4-86d2-b6423f588093'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:34.725866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0cc12fac57d41a0a0eb330b8cf7ff49', 'request_id': 'req-2d88cbf9-39f9-44d4-86d2-b6423f588093'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:34.761169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] The token cache is being invalidate because project f0cc12fac57d41a0a0eb330b8cf7ff49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:34.761738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:34.762831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:34.765614 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1088/2170] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:34 2021] DELETE /identity/v3/projects/f0cc12fac57d41a0a0eb330b8cf7ff49 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:34.770805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:34.775807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:34.807827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e38a8-536a-46b5-b8ce-8ac2a172df0b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:34.968079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:34.970144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:34.971069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:34.971739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] PATH_INFO: `/v3/users/0881170257e54a37963549d703b54736` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:34.973990 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0881170257e54a37963549d703b54736)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:34.979023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:35.070168 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0881170257e54a37963549d703b54736'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.082760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0881170257e54a37963549d703b54736'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.083624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0881170257e54a37963549d703b54736'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.085202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0881170257e54a37963549d703b54736'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.099600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4748ddf6-d42c-4787-b773-432c04e621e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0881170257e54a37963549d703b54736'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.138548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:35.140414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:35.171595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88cbf9-39f9-44d4-86d2-b6423f588093 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:35.193240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:35.195502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:35.196418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:35.197099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] PATH_INFO: `/v3/projects/0a37960012344d2ea5ecb793107493ee` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:35.199116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a37960012344d2ea5ecb793107493ee)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:35.200295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1083/2171] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:34 2021] DELETE /identity/v3/users/0881170257e54a37963549d703b54736 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:35.202649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:35.336735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a37960012344d2ea5ecb793107493ee', 'request_id': 'req-de71b371-7a31-464b-a8e9-d785f033696b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.347691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a37960012344d2ea5ecb793107493ee', 'request_id': 'req-de71b371-7a31-464b-a8e9-d785f033696b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.362915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a37960012344d2ea5ecb793107493ee', 'request_id': 'req-de71b371-7a31-464b-a8e9-d785f033696b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.399837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] The token cache is being invalidate because project 0a37960012344d2ea5ecb793107493ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:35.400754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.401500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-de71b371-7a31-464b-a8e9-d785f033696b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:35.404351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1089/2172] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:35 2021] DELETE /identity/v3/projects/0a37960012344d2ea5ecb793107493ee => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:35.411648 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c6b1-6b3f-4595-8c13-cf8d6e24ca6a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:35.412022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c6b1-6b3f-4595-8c13-cf8d6e24ca6a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:35.412537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c6b1-6b3f-4595-8c13-cf8d6e24ca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:35.444560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-dca5c6b1-6b3f-4595-8c13-cf8d6e24ca6a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:35.446662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-dca5c6b1-6b3f-4595-8c13-cf8d6e24ca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:35.582490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1084/2173] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:35.585557 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1004745-0e70-49a5-8514-7315791bd448 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:35.586076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1004745-0e70-49a5-8514-7315791bd448 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:35.586629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1004745-0e70-49a5-8514-7315791bd448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:35.628761 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f1004745-0e70-49a5-8514-7315791bd448 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:35.630853 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f1004745-0e70-49a5-8514-7315791bd448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:35.645770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1090/2174] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:35.650874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c6b1-6b3f-4595-8c13-cf8d6e24ca6a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:35.672583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c6b1-6b3f-4595-8c13-cf8d6e24ca6a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:35.681543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:35.683694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:35.683694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:35.683694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:35.685348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:35.686736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:35.690655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:35.717887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1085/2175] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:59:35.723678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1004745-0e70-49a5-8514-7315791bd448 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:35.741357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1004745-0e70-49a5-8514-7315791bd448 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:35.750233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28cbc1-eb56-4974-9d9f-c4994fb0707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:35.751738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28cbc1-eb56-4974-9d9f-c4994fb0707b admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:35.752335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28cbc1-eb56-4974-9d9f-c4994fb0707b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:35.752925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28cbc1-eb56-4974-9d9f-c4994fb0707b admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:35.753837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28cbc1-eb56-4974-9d9f-c4994fb0707b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:35.758183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28cbc1-eb56-4974-9d9f-c4994fb0707b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:35.809659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1091/2176] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:35 2021] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:35.811861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:35.841935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8af41-0004-4585-95be-9705e0494ab6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:35.985263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab53f3-2d3e-4660-b9f3-5d32bf9cb23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:35.986005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab53f3-2d3e-4660-b9f3-5d32bf9cb23b admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:35.986518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab53f3-2d3e-4660-b9f3-5d32bf9cb23b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:35.986842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab53f3-2d3e-4660-b9f3-5d32bf9cb23b admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:35.987591 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab53f3-2d3e-4660-b9f3-5d32bf9cb23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:35.989836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab53f3-2d3e-4660-b9f3-5d32bf9cb23b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:36.015367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1086/2177] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:35 2021] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:36.020725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28cbc1-eb56-4974-9d9f-c4994fb0707b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:36.034646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28cbc1-eb56-4974-9d9f-c4994fb0707b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:36.040454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e591019-f2e9-435a-91d4-f66b8992d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:36.041428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e591019-f2e9-435a-91d4-f66b8992d9bc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:36.042008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e591019-f2e9-435a-91d4-f66b8992d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:36.042394 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e591019-f2e9-435a-91d4-f66b8992d9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:36.043328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e591019-f2e9-435a-91d4-f66b8992d9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:36.045144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e591019-f2e9-435a-91d4-f66b8992d9bc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:36.059292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1092/2178] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:36 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:59:36.064799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab53f3-2d3e-4660-b9f3-5d32bf9cb23b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:36.079539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab53f3-2d3e-4660-b9f3-5d32bf9cb23b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:36.088153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147ad36-970f-4b21-809d-1d94aae9324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:36.089004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147ad36-970f-4b21-809d-1d94aae9324a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:36.089588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147ad36-970f-4b21-809d-1d94aae9324a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:36.090156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147ad36-970f-4b21-809d-1d94aae9324a admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:36.091623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147ad36-970f-4b21-809d-1d94aae9324a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:36.095557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147ad36-970f-4b21-809d-1d94aae9324a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:36.124193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1087/2179] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:36 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:36.126154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e591019-f2e9-435a-91d4-f66b8992d9bc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:36.147825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e591019-f2e9-435a-91d4-f66b8992d9bc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:36.157337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:36.159203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:36.159970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:36.160674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] PATH_INFO: `/v3/projects/5d4bbb9314584bf68c53a29f6b716f92/users/ce05e1f2e78a4c989c748963bdb1ea35/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:36.218880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4bbb9314584bf68c53a29f6b716f92, user_id=ce05e1f2e78a4c989c748963bdb1ea35, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:36.226610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:36.278521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1093/2180] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:36 2021] PUT /identity/v3/projects/5d4bbb9314584bf68c53a29f6b716f92/users/ce05e1f2e78a4c989c748963bdb1ea35/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:36.283890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f6f83-7b2b-4e94-88c2-97a752e0347b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:36.284574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f6f83-7b2b-4e94-88c2-97a752e0347b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:36.285178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f6f83-7b2b-4e94-88c2-97a752e0347b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:36.370150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-2e8f6f83-7b2b-4e94-88c2-97a752e0347b None None] MFA Rules not processed for user `ce05e1f2e78a4c989c748963bdb1ea35`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:36.373234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2e8f6f83-7b2b-4e94-88c2-97a752e0347b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:36.508266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:36.511428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:36.515771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1088/2181] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:36 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:36.524162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f6f83-7b2b-4e94-88c2-97a752e0347b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:36.682821 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f6f83-7b2b-4e94-88c2-97a752e0347b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:36.688269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14d134-45f7-4c70-8aea-c04e3d273e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:36.689197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e74b3c-f400-47f0-a215-0c000db15967 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:36.689362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14d134-45f7-4c70-8aea-c04e3d273e58 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:36.689887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14d134-45f7-4c70-8aea-c04e3d273e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:36.690827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14d134-45f7-4c70-8aea-c04e3d273e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:36.691710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14d134-45f7-4c70-8aea-c04e3d273e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:36.694265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14d134-45f7-4c70-8aea-c04e3d273e58 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:36.698299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:36.700216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:36.701254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:36.701898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] PATH_INFO: `/v3/projects/dfefa27414e948f3a7fb390f6b3de7e4` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:36.705743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfefa27414e948f3a7fb390f6b3de7e4)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:36.710120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:36.764181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1089/2182] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:36 2021] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:36.769561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14d134-45f7-4c70-8aea-c04e3d273e58 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:36.865240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfefa27414e948f3a7fb390f6b3de7e4', 'request_id': 'req-51d92156-dc28-4b7d-802f-fe376c245fe1'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:36.887645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfefa27414e948f3a7fb390f6b3de7e4', 'request_id': 'req-51d92156-dc28-4b7d-802f-fe376c245fe1'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:36.915800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfefa27414e948f3a7fb390f6b3de7e4', 'request_id': 'req-51d92156-dc28-4b7d-802f-fe376c245fe1'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:36.961588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14d134-45f7-4c70-8aea-c04e3d273e58 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:36.978058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] The token cache is being invalidate because project dfefa27414e948f3a7fb390f6b3de7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:36.978710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:36.991216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-51d92156-dc28-4b7d-802f-fe376c245fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:36.996785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1094/2183] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:36 2021] DELETE /identity/v3/projects/dfefa27414e948f3a7fb390f6b3de7e4 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:37.006909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7e7c3-b18d-4969-ba5d-acdf7f142c4e None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.007628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7e7c3-b18d-4969-ba5d-acdf7f142c4e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.008350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7e7c3-b18d-4969-ba5d-acdf7f142c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.064914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-82b7e7c3-b18d-4969-ba5d-acdf7f142c4e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:37.067863 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-82b7e7c3-b18d-4969-ba5d-acdf7f142c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:37.096708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.097599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.098050 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.098518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.101394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.104428 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.155704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1090/2184] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:36 2021] POST /identity/v3/users => generated 291 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:37.160705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.167117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:37.198458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd074b6-9289-48e4-9e1a-c3f092a81d8d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.221111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91eba5-b198-4ebe-9450-f89630896f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.223550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91eba5-b198-4ebe-9450-f89630896f8a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.225617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91eba5-b198-4ebe-9450-f89630896f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.226693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91eba5-b198-4ebe-9450-f89630896f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.228329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91eba5-b198-4ebe-9450-f89630896f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.234282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91eba5-b198-4ebe-9450-f89630896f8a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.253661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1095/2185] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:37.267447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3aece-1927-4ef5-b2d8-5c4bebe8c361 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.268275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3aece-1927-4ef5-b2d8-5c4bebe8c361 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.268707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3aece-1927-4ef5-b2d8-5c4bebe8c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.280082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1091/2186] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:37 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:37.282040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91eba5-b198-4ebe-9450-f89630896f8a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.321323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-caf3aece-1927-4ef5-b2d8-5c4bebe8c361 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:37.321966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91eba5-b198-4ebe-9450-f89630896f8a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.322570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-caf3aece-1927-4ef5-b2d8-5c4bebe8c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:37.335426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c978d5-f852-4809-bf80-d1e2fc80de75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.341431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c978d5-f852-4809-bf80-d1e2fc80de75 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.341832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c978d5-f852-4809-bf80-d1e2fc80de75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.342936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c978d5-f852-4809-bf80-d1e2fc80de75 admin admin] PATH_INFO: `/v3/projects/114a7d9a1d9340f3aec94ef2334fc118/users/b4e9c240d9d147a68317fd2acf916f49/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.343871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1096/2187] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:37.350165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3aece-1927-4ef5-b2d8-5c4bebe8c361 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.367112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3aece-1927-4ef5-b2d8-5c4bebe8c361 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.391789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83d251-6744-445b-933e-087854833589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.392425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d251-6744-445b-933e-087854833589 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.392713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d251-6744-445b-933e-087854833589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.392995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d251-6744-445b-933e-087854833589 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.393716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83d251-6744-445b-933e-087854833589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:37.394013 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83d251-6744-445b-933e-087854833589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.395793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83d251-6744-445b-933e-087854833589 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.404001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c978d5-f852-4809-bf80-d1e2fc80de75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114a7d9a1d9340f3aec94ef2334fc118, user_id=b4e9c240d9d147a68317fd2acf916f49, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.410773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c978d5-f852-4809-bf80-d1e2fc80de75 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.413417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1097/2188] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:37.421549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83d251-6744-445b-933e-087854833589 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.442495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1092/2189] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:37 2021] PUT /identity/v3/projects/114a7d9a1d9340f3aec94ef2334fc118/users/b4e9c240d9d147a68317fd2acf916f49/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:37.449083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c978d5-f852-4809-bf80-d1e2fc80de75 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.451263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83d251-6744-445b-933e-087854833589 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.563544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c978d5-f852-4809-bf80-d1e2fc80de75 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.570122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b732e1b-f0f2-4604-84c9-f4831b647bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.570901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b732e1b-f0f2-4604-84c9-f4831b647bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.571274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b732e1b-f0f2-4604-84c9-f4831b647bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.571621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b732e1b-f0f2-4604-84c9-f4831b647bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.572483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b732e1b-f0f2-4604-84c9-f4831b647bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.574347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b732e1b-f0f2-4604-84c9-f4831b647bf7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.586481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd19b04-bea7-49b0-bea7-0a62d29e5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.592477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1093/2190] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:37 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:37.592647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19b04-bea7-49b0-bea7-0a62d29e5442 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.592647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19b04-bea7-49b0-bea7-0a62d29e5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.592647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19b04-bea7-49b0-bea7-0a62d29e5442 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.592647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd19b04-bea7-49b0-bea7-0a62d29e5442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.594350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b732e1b-f0f2-4604-84c9-f4831b647bf7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.594741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd19b04-bea7-49b0-bea7-0a62d29e5442 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.606971 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b732e1b-f0f2-4604-84c9-f4831b647bf7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.613872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be0633-05df-4e08-802d-74ac8229c881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.614863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0633-05df-4e08-802d-74ac8229c881 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.616151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0633-05df-4e08-802d-74ac8229c881 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.616636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0633-05df-4e08-802d-74ac8229c881 admin admin] PATH_INFO: `/v3/projects/114a7d9a1d9340f3aec94ef2334fc118/users/b4e9c240d9d147a68317fd2acf916f49/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.619123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be0633-05df-4e08-802d-74ac8229c881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114a7d9a1d9340f3aec94ef2334fc118, user_id=b4e9c240d9d147a68317fd2acf916f49, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.622150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be0633-05df-4e08-802d-74ac8229c881 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.652378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1094/2191] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:37 2021] PUT /identity/v3/projects/114a7d9a1d9340f3aec94ef2334fc118/users/b4e9c240d9d147a68317fd2acf916f49/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:37.658591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1098/2192] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:37 2021] POST /identity/v3/projects => generated 359 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:37.660085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d571-a1c3-499e-beeb-a0b20e271e00 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.660811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d571-a1c3-499e-beeb-a0b20e271e00 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.661534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d571-a1c3-499e-beeb-a0b20e271e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.663442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd19b04-bea7-49b0-bea7-0a62d29e5442 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.733345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4e20d571-a1c3-499e-beeb-a0b20e271e00 None None] MFA Rules not processed for user `b4e9c240d9d147a68317fd2acf916f49`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:37.736597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4e20d571-a1c3-499e-beeb-a0b20e271e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:37.757974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd19b04-bea7-49b0-bea7-0a62d29e5442 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.763905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858e0d2-0750-491f-9d67-48ef854d732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.764556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858e0d2-0750-491f-9d67-48ef854d732a admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.764993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858e0d2-0750-491f-9d67-48ef854d732a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.765413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858e0d2-0750-491f-9d67-48ef854d732a admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.766565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858e0d2-0750-491f-9d67-48ef854d732a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.769053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858e0d2-0750-491f-9d67-48ef854d732a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.803808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1099/2193] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:37 2021] POST /identity/v3/users => generated 280 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:37.806364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858e0d2-0750-491f-9d67-48ef854d732a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.819932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858e0d2-0750-491f-9d67-48ef854d732a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.824907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5496-0204-4647-9baa-9aa63773734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.825530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5496-0204-4647-9baa-9aa63773734b admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.825875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5496-0204-4647-9baa-9aa63773734b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.826226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5496-0204-4647-9baa-9aa63773734b admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.826860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5496-0204-4647-9baa-9aa63773734b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.828506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5496-0204-4647-9baa-9aa63773734b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.844910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1100/2194] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:37 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:59:37.846224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5496-0204-4647-9baa-9aa63773734b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.885901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5496-0204-4647-9baa-9aa63773734b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:37.911758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbbb26-e8fd-4616-b010-214f6a6761a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:37.915111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbbb26-e8fd-4616-b010-214f6a6761a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:37.915636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbbb26-e8fd-4616-b010-214f6a6761a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:37.916179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbbb26-e8fd-4616-b010-214f6a6761a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:37.917558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbbb26-e8fd-4616-b010-214f6a6761a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:37.921368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbbb26-e8fd-4616-b010-214f6a6761a5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:37.950107 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1095/2195] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:37 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:37.957449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d571-a1c3-499e-beeb-a0b20e271e00 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.964980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4e20d571-a1c3-499e-beeb-a0b20e271e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:37.965949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1101/2196] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:37 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:37.968925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbbb26-e8fd-4616-b010-214f6a6761a5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:37.993546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbbb26-e8fd-4616-b010-214f6a6761a5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:38.002559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff0533-1b87-4535-8514-658ab5a54570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:38.004215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff0533-1b87-4535-8514-658ab5a54570 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:38.004738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff0533-1b87-4535-8514-658ab5a54570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:38.005246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff0533-1b87-4535-8514-658ab5a54570 admin admin] PATH_INFO: `/v3/projects/a4b2ad2f6f4f4054a522a7c0e50ac886/users/0e57b560818444fbbf81e4003a200de4/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:38.039206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff0533-1b87-4535-8514-658ab5a54570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b2ad2f6f4f4054a522a7c0e50ac886, user_id=0e57b560818444fbbf81e4003a200de4, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:38.044785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff0533-1b87-4535-8514-658ab5a54570 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:38.072495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1102/2197] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:37 2021] PUT /identity/v3/projects/a4b2ad2f6f4f4054a522a7c0e50ac886/users/0e57b560818444fbbf81e4003a200de4/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:38.089167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740c7a-743d-4ea3-8057-e039c8fd5a1c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:38.089658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740c7a-743d-4ea3-8057-e039c8fd5a1c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:38.090124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740c7a-743d-4ea3-8057-e039c8fd5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:38.122843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d571-a1c3-499e-beeb-a0b20e271e00 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:38.166900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1c740c7a-743d-4ea3-8057-e039c8fd5a1c None None] MFA Rules not processed for user `0e57b560818444fbbf81e4003a200de4`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:38.169999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1c740c7a-743d-4ea3-8057-e039c8fd5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:38.372276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1103/2198] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:38 2021] POST /identity/v3/auth/tokens => generated 3666 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:38.410955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7ffa7-2159-4cd1-8678-7d983e651c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:38.411871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7ffa7-2159-4cd1-8678-7d983e651c31 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:38.412832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7ffa7-2159-4cd1-8678-7d983e651c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:38.413246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7ffa7-2159-4cd1-8678-7d983e651c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:38.529062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7ffa7-2159-4cd1-8678-7d983e651c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:38.531180 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7ffa7-2159-4cd1-8678-7d983e651c31 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:38.545812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1096/2199] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:37 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:38.656253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c740c7a-743d-4ea3-8057-e039c8fd5a1c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:38.666836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57a66-1389-4ae0-a02d-2f3b20010498 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:38.668112 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57a66-1389-4ae0-a02d-2f3b20010498 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:38.668112 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57a66-1389-4ae0-a02d-2f3b20010498 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:38.671488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1097/2200] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 25 14:59:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 14:59:38.679700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd19ebb-af51-4a1d-b9ab-35fc7b95ab10 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:38.680054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c740c7a-743d-4ea3-8057-e039c8fd5a1c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:38.680222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd19ebb-af51-4a1d-b9ab-35fc7b95ab10 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:38.680702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd19ebb-af51-4a1d-b9ab-35fc7b95ab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:38.692531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544a536-4944-469a-9c44-0a00dd3abe2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:38.694294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544a536-4944-469a-9c44-0a00dd3abe2b service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:38.694767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544a536-4944-469a-9c44-0a00dd3abe2b service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:38.695218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544a536-4944-469a-9c44-0a00dd3abe2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:38.699458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3544a536-4944-469a-9c44-0a00dd3abe2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:38.732691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-cbd19ebb-af51-4a1d-b9ab-35fc7b95ab10 None None] MFA Rules not processed for user `29ed619258a14a148654f372f3a6a6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:38.733988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-cbd19ebb-af51-4a1d-b9ab-35fc7b95ab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:38.744111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1098/2201] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 25 14:59:38 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:38.758071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd19ebb-af51-4a1d-b9ab-35fc7b95ab10 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:38.774364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd19ebb-af51-4a1d-b9ab-35fc7b95ab10 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:38.779332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d4830-bffe-47b4-9960-e82bc6a13a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:38.780113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d4830-bffe-47b4-9960-e82bc6a13a54 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:38.780730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d4830-bffe-47b4-9960-e82bc6a13a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:38.781002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d4830-bffe-47b4-9960-e82bc6a13a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:38.806125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d4830-bffe-47b4-9960-e82bc6a13a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:38.807640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d4830-bffe-47b4-9960-e82bc6a13a54 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:38.829578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1099/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:38 2021] GET /identity/v3/auth/tokens => generated 3666 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:59:38.929594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544a536-4944-469a-9c44-0a00dd3abe2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:38.933262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544a536-4944-469a-9c44-0a00dd3abe2b service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:38.968214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1104/2203] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:38 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:39.118103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d4830-bffe-47b4-9960-e82bc6a13a54 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:39.216382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d4830-bffe-47b4-9960-e82bc6a13a54 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:39.235125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:39.237158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:39.237833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:39.238726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] PATH_INFO: `/v3/users/0e57b560818444fbbf81e4003a200de4` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:39.243966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e57b560818444fbbf81e4003a200de4)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:39.249385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:39.392398 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e57b560818444fbbf81e4003a200de4'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:39.409481 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e57b560818444fbbf81e4003a200de4'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:39.410550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e57b560818444fbbf81e4003a200de4'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:39.411595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e57b560818444fbbf81e4003a200de4'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:39.460250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e57b560818444fbbf81e4003a200de4'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:39.506066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1100/2204] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:39 2021] DELETE /identity/v3/users/0e57b560818444fbbf81e4003a200de4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:39.514377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b4ee-6f72-41e5-892c-b73be1f820e4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:39.515248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b4ee-6f72-41e5-892c-b73be1f820e4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:39.519360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b4ee-6f72-41e5-892c-b73be1f820e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:39.603861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-dca1b4ee-6f72-41e5-892c-b73be1f820e4 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:39.606098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-dca1b4ee-6f72-41e5-892c-b73be1f820e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:39.816351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1105/2205] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:39.828061 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:39.831134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:40.057754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38482c1f-51cb-40f9-a388-eb53ae3ceced admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:40.074102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a742c45-f907-44df-9b31-80fa03fba6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:40.076441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742c45-f907-44df-9b31-80fa03fba6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:40.076441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742c45-f907-44df-9b31-80fa03fba6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:40.076441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742c45-f907-44df-9b31-80fa03fba6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:40.092526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a742c45-f907-44df-9b31-80fa03fba6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:40.094085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a742c45-f907-44df-9b31-80fa03fba6c8 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:40.126894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1101/2206] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:40.791897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b4ee-6f72-41e5-892c-b73be1f820e4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:40.794829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-dca1b4ee-6f72-41e5-892c-b73be1f820e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:40.819532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b4ee-6f72-41e5-892c-b73be1f820e4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:40.830057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:40.833083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:40.834615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:40.835611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] PATH_INFO: `/v3/projects/a4b2ad2f6f4f4054a522a7c0e50ac886` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:40.838160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b2ad2f6f4f4054a522a7c0e50ac886)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:40.842583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:40.964827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b2ad2f6f4f4054a522a7c0e50ac886', 'request_id': 'req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:40.975171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b2ad2f6f4f4054a522a7c0e50ac886', 'request_id': 'req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:40.988731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b2ad2f6f4f4054a522a7c0e50ac886', 'request_id': 'req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:41.010008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] The token cache is being invalidate because project a4b2ad2f6f4f4054a522a7c0e50ac886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:41.010284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:41.011239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-d3db4150-ce77-4e1a-8bae-1bfe7e00346d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:41.013885 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1106/2207] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:40 2021] DELETE /identity/v3/projects/a4b2ad2f6f4f4054a522a7c0e50ac886 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:41.020777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e20a7-d38c-47a5-b43d-00a63dc52a35 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.021386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e20a7-d38c-47a5-b43d-00a63dc52a35 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.022039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e20a7-d38c-47a5-b43d-00a63dc52a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.048193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c82e20a7-d38c-47a5-b43d-00a63dc52a35 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:41.049564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c82e20a7-d38c-47a5-b43d-00a63dc52a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:41.127411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1102/2208] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:41.136728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18d49-1479-4226-85e1-e3fdbe25d0b8 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.137018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18d49-1479-4226-85e1-e3fdbe25d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.137304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18d49-1479-4226-85e1-e3fdbe25d0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.161458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-71d18d49-1479-4226-85e1-e3fdbe25d0b8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:41.163602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-71d18d49-1479-4226-85e1-e3fdbe25d0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:41.189701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1107/2209] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:41.191598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e20a7-d38c-47a5-b43d-00a63dc52a35 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:41.207990 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e20a7-d38c-47a5-b43d-00a63dc52a35 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:41.215857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:41.216964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.217412 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.217995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.219219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:41.220150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:41.222843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:41.251031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1103/2210] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:41.252919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d18d49-1479-4226-85e1-e3fdbe25d0b8 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:41.263889 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d18d49-1479-4226-85e1-e3fdbe25d0b8 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:41.268471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b368dc-743f-45d0-85ba-199475d88afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:41.269082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b368dc-743f-45d0-85ba-199475d88afc admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.269396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b368dc-743f-45d0-85ba-199475d88afc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.269680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b368dc-743f-45d0-85ba-199475d88afc admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.270322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b368dc-743f-45d0-85ba-199475d88afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:41.272819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b368dc-743f-45d0-85ba-199475d88afc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:41.306445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1108/2211] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:41 2021] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:41.309353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:41.320840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b50de8-fb13-41fe-b87a-d176c021f245 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:41.403888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178e17-604c-4a18-88e0-4bce8b70ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:41.404832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178e17-604c-4a18-88e0-4bce8b70ec60 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.405347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178e17-604c-4a18-88e0-4bce8b70ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.405794 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178e17-604c-4a18-88e0-4bce8b70ec60 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.406581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2178e17-604c-4a18-88e0-4bce8b70ec60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:41.408798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2178e17-604c-4a18-88e0-4bce8b70ec60 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:41.437022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1104/2212] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:41 2021] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:41.438924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b368dc-743f-45d0-85ba-199475d88afc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:41.457283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b368dc-743f-45d0-85ba-199475d88afc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:41.482395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f8f71-bec9-4044-bb4f-d34b33e037ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:41.483555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8f71-bec9-4044-bb4f-d34b33e037ef admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.484042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8f71-bec9-4044-bb4f-d34b33e037ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.484540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8f71-bec9-4044-bb4f-d34b33e037ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.486074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f8f71-bec9-4044-bb4f-d34b33e037ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:41.488789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f8f71-bec9-4044-bb4f-d34b33e037ef admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:41.502902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1109/2213] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:41 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:41.507419 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178e17-604c-4a18-88e0-4bce8b70ec60 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:41.518041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178e17-604c-4a18-88e0-4bce8b70ec60 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:41.523724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a72c4-b374-4182-bcdd-e7a3216d0124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:41.524395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a72c4-b374-4182-bcdd-e7a3216d0124 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.524686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a72c4-b374-4182-bcdd-e7a3216d0124 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.524963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a72c4-b374-4182-bcdd-e7a3216d0124 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.525671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a72c4-b374-4182-bcdd-e7a3216d0124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:41.527327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a72c4-b374-4182-bcdd-e7a3216d0124 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:41.540319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1105/2214] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:41.545872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f8f71-bec9-4044-bb4f-d34b33e037ef admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:41.557503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f8f71-bec9-4044-bb4f-d34b33e037ef admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:41.562948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349caa3-419d-471a-b288-377466eb53fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:41.564002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349caa3-419d-471a-b288-377466eb53fa admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.564421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349caa3-419d-471a-b288-377466eb53fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.564933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349caa3-419d-471a-b288-377466eb53fa admin admin] PATH_INFO: `/v3/projects/1a35a8f34ccd4f299e70454da54deed0/users/51aca3a2758d4c74bcb9937caab6c691/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.592497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349caa3-419d-471a-b288-377466eb53fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a35a8f34ccd4f299e70454da54deed0, user_id=51aca3a2758d4c74bcb9937caab6c691, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:41.596393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349caa3-419d-471a-b288-377466eb53fa admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:41.630104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1110/2215] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:41 2021] PUT /identity/v3/projects/1a35a8f34ccd4f299e70454da54deed0/users/51aca3a2758d4c74bcb9937caab6c691/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:41.634146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8b23-b350-4225-9343-9f813ee9138d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:41.634473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8b23-b350-4225-9343-9f813ee9138d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:41.634784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8b23-b350-4225-9343-9f813ee9138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:41.737287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a52f8b23-b350-4225-9343-9f813ee9138d None None] MFA Rules not processed for user `51aca3a2758d4c74bcb9937caab6c691`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:41.738880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a52f8b23-b350-4225-9343-9f813ee9138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:41.838803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1106/2216] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:41 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:41.844045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349caa3-419d-471a-b288-377466eb53fa admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:42.076799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349caa3-419d-471a-b288-377466eb53fa admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:42.082260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4ee2f-5eed-40ef-be70-7736a5aef422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:42.086469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ee2f-5eed-40ef-be70-7736a5aef422 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.086469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ee2f-5eed-40ef-be70-7736a5aef422 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.086469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ee2f-5eed-40ef-be70-7736a5aef422 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.086469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4ee2f-5eed-40ef-be70-7736a5aef422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:42.087243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4ee2f-5eed-40ef-be70-7736a5aef422 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:42.131771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1111/2217] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:41 2021] POST /identity/v3/projects => generated 373 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:42.133747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8b23-b350-4225-9343-9f813ee9138d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:42.163727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8b23-b350-4225-9343-9f813ee9138d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:42.170457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fcf0b-30b1-46c8-adb5-ae56579d72e5 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.171096 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fcf0b-30b1-46c8-adb5-ae56579d72e5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.171577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fcf0b-30b1-46c8-adb5-ae56579d72e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.209991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-563fcf0b-30b1-46c8-adb5-ae56579d72e5 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:42.211429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-563fcf0b-30b1-46c8-adb5-ae56579d72e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:42.262393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f739a2-3d78-4c2b-9195-c2c8380774a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:42.263349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f739a2-3d78-4c2b-9195-c2c8380774a9 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.263873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f739a2-3d78-4c2b-9195-c2c8380774a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.264395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f739a2-3d78-4c2b-9195-c2c8380774a9 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.265298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f739a2-3d78-4c2b-9195-c2c8380774a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:42.269354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f739a2-3d78-4c2b-9195-c2c8380774a9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:42.301166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1107/2218] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:42 2021] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:42.305352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f739a2-3d78-4c2b-9195-c2c8380774a9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:42.324382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f739a2-3d78-4c2b-9195-c2c8380774a9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:42.332240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:42.332878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.333410 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.333709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.335273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:42.337695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:42.362689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1112/2219] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 14:59:42 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 25 14:59:42.370700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1108/2220] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:42 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:59:42.376136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fcf0b-30b1-46c8-adb5-ae56579d72e5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:42.394587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fcf0b-30b1-46c8-adb5-ae56579d72e5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:42.406533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a96c6-502c-4888-bc75-cc3e9c354c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:42.408310 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a96c6-502c-4888-bc75-cc3e9c354c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.408866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a96c6-502c-4888-bc75-cc3e9c354c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.409403 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a96c6-502c-4888-bc75-cc3e9c354c81 admin admin] PATH_INFO: `/v3/projects/17f1c6a0b654457ab5205a5d7e124496/users/47b82b58a67d4054b075a0df0b090b94/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.427133 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:42.434534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:42.469506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a96c6-502c-4888-bc75-cc3e9c354c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f1c6a0b654457ab5205a5d7e124496, user_id=47b82b58a67d4054b075a0df0b090b94, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:42.473031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a96c6-502c-4888-bc75-cc3e9c354c81 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:42.514084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1113/2221] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:42 2021] PUT /identity/v3/projects/17f1c6a0b654457ab5205a5d7e124496/users/47b82b58a67d4054b075a0df0b090b94/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:42.515520 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a96c6-502c-4888-bc75-cc3e9c354c81 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:42.543238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b4286-2e6e-4314-8d7f-4623ab133642 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:42.613213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a96c6-502c-4888-bc75-cc3e9c354c81 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:42.618342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a05306-cbf2-41fc-b191-00be6751ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:42.619382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05306-cbf2-41fc-b191-00be6751ac33 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.620259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05306-cbf2-41fc-b191-00be6751ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.620732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05306-cbf2-41fc-b191-00be6751ac33 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.621662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a05306-cbf2-41fc-b191-00be6751ac33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:42.623341 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a05306-cbf2-41fc-b191-00be6751ac33 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:42.641222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1114/2222] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:42 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:42.642340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a05306-cbf2-41fc-b191-00be6751ac33 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:42.643296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:42.644076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.644679 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.645110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.653862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a05306-cbf2-41fc-b191-00be6751ac33 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:42.659489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5726-3bce-4499-be9e-463ddcc20d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:42.660676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5726-3bce-4499-be9e-463ddcc20d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.660807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5726-3bce-4499-be9e-463ddcc20d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.661388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5726-3bce-4499-be9e-463ddcc20d9d admin admin] PATH_INFO: `/v3/projects/17f1c6a0b654457ab5205a5d7e124496/users/47b82b58a67d4054b075a0df0b090b94/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.663802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5726-3bce-4499-be9e-463ddcc20d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f1c6a0b654457ab5205a5d7e124496, user_id=47b82b58a67d4054b075a0df0b090b94, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:42.666695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5726-3bce-4499-be9e-463ddcc20d9d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:42.690128 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1115/2223] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:42 2021] PUT /identity/v3/projects/17f1c6a0b654457ab5205a5d7e124496/users/47b82b58a67d4054b075a0df0b090b94/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:42.701634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4bc3-dc6d-4ae1-9a0e-2f6f467ca2f0 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:42.701634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4bc3-dc6d-4ae1-9a0e-2f6f467ca2f0 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:42.702314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4bc3-dc6d-4ae1-9a0e-2f6f467ca2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:42.799843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:42.800410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-d6de4bc3-dc6d-4ae1-9a0e-2f6f467ca2f0 None None] MFA Rules not processed for user `47b82b58a67d4054b075a0df0b090b94`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:42.803454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:42.805377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d6de4bc3-dc6d-4ae1-9a0e-2f6f467ca2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:42.824379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1109/2224] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 14:59:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 14:59:43.078582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1116/2225] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:42 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:43.246512 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:43.249091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:43.338374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e77c7f-9904-4d63-b352-76b0f49fd837 service swift] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:43.489544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:43.490917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:43.491337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:43.491627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:43.602997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:43.604699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:43.616573 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1110/2226] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:43 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:59:44.765289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a811229-61a4-492b-a01a-e93c2f84a2ae None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:44.768528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a811229-61a4-492b-a01a-e93c2f84a2ae None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:44.769041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a811229-61a4-492b-a01a-e93c2f84a2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:44.795072 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:44.796854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:44.829015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-8a811229-61a4-492b-a01a-e93c2f84a2ae None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:44.832332 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8a811229-61a4-492b-a01a-e93c2f84a2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:44.961058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c84bd6-4b85-42a0-a513-bcd5a8b4443a service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:44.965679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1117/2227] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 14:59:44 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:44.966140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:44.967082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:44.967432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:44.967836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] PATH_INFO: `/v3/users/ce05e1f2e78a4c989c748963bdb1ea35` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:44.969080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce05e1f2e78a4c989c748963bdb1ea35)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:44.971153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:44.984735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a811229-61a4-492b-a01a-e93c2f84a2ae None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:45.035373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce05e1f2e78a4c989c748963bdb1ea35'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:45.045678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce05e1f2e78a4c989c748963bdb1ea35'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:45.046471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce05e1f2e78a4c989c748963bdb1ea35'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:45.047110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce05e1f2e78a4c989c748963bdb1ea35'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:45.056941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-87542866-415c-46d5-9559-7a6524250eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce05e1f2e78a4c989c748963bdb1ea35'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:45.081811 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1111/2228] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:44 2021] DELETE /identity/v3/users/ce05e1f2e78a4c989c748963bdb1ea35 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:45.086465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a811229-61a4-492b-a01a-e93c2f84a2ae None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:45.089292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf25c-20ea-4f5a-a295-50ccc50ae094 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:45.089763 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf25c-20ea-4f5a-a295-50ccc50ae094 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:45.090232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf25c-20ea-4f5a-a295-50ccc50ae094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:45.130244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-38ccf25c-20ea-4f5a-a295-50ccc50ae094 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:45.132451 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-38ccf25c-20ea-4f5a-a295-50ccc50ae094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:45.234931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:45.236877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:45.238852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:45.239638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:45.246978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:45.260927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1112/2229] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:45.285965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccf25c-20ea-4f5a-a295-50ccc50ae094 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:45.291734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-38ccf25c-20ea-4f5a-a295-50ccc50ae094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:45.362685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:45.364477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:45.374732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1118/2230] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 14:59:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 25 14:59:45.392576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccf25c-20ea-4f5a-a295-50ccc50ae094 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:45.398169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e973b-fd19-4626-a679-59cbe95a5ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:45.399115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e973b-fd19-4626-a679-59cbe95a5ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:45.399614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e973b-fd19-4626-a679-59cbe95a5ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:45.400100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e973b-fd19-4626-a679-59cbe95a5ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:45.412917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e973b-fd19-4626-a679-59cbe95a5ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:45.414685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e973b-fd19-4626-a679-59cbe95a5ce9 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:45.427597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1113/2231] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:46.007845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:46.010236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:46.033452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf271974-daed-4d1f-94bd-263bfca03e91 service swift] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:46.039711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:46.040229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:46.040474 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:46.040736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] PATH_INFO: `/v3/projects/5d4bbb9314584bf68c53a29f6b716f92` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:46.042392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4bbb9314584bf68c53a29f6b716f92)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:46.044348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:46.063307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75039380-9541-4d88-aa0f-2ce5d0611b2b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:46.063909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75039380-9541-4d88-aa0f-2ce5d0611b2b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:46.064320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75039380-9541-4d88-aa0f-2ce5d0611b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:46.093676 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-75039380-9541-4d88-aa0f-2ce5d0611b2b None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:46.094928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-75039380-9541-4d88-aa0f-2ce5d0611b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:46.122088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4bbb9314584bf68c53a29f6b716f92', 'request_id': 'req-99b2a497-59f5-48d4-94e9-25d9e3e13df9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.131915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4bbb9314584bf68c53a29f6b716f92', 'request_id': 'req-99b2a497-59f5-48d4-94e9-25d9e3e13df9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.141262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4bbb9314584bf68c53a29f6b716f92', 'request_id': 'req-99b2a497-59f5-48d4-94e9-25d9e3e13df9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.169273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1114/2232] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 25 14:59:46 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:46.176816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] The token cache is being invalidate because project 5d4bbb9314584bf68c53a29f6b716f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:46.177479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.178739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.181188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1119/2233] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:46 2021] DELETE /identity/v3/projects/5d4bbb9314584bf68c53a29f6b716f92 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:46.185904 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:46.186116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75039380-9541-4d88-aa0f-2ce5d0611b2b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:46.187592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:46.281291 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75039380-9541-4d88-aa0f-2ce5d0611b2b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:46.287544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a497-59f5-48d4-94e9-25d9e3e13df9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:46.288620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:46.289870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:46.290338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:46.290941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] PATH_INFO: `/v3/users/b4e9c240d9d147a68317fd2acf916f49` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:46.293390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e9c240d9d147a68317fd2acf916f49)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:46.294010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:46.294924 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:46.295209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:46.295484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:46.297654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:46.300715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:46.310444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:46.312204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:46.323044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1120/2234] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 14:59:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 25 14:59:46.417074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e9c240d9d147a68317fd2acf916f49'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.433006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e9c240d9d147a68317fd2acf916f49'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.434813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e9c240d9d147a68317fd2acf916f49'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.436179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e9c240d9d147a68317fd2acf916f49'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.459416 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-403ea57a-b87b-4e7a-a06b-77ddf122c9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e9c240d9d147a68317fd2acf916f49'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:46.495718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1115/2235] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:46 2021] DELETE /identity/v3/users/b4e9c240d9d147a68317fd2acf916f49 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:47.016048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:47.018145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:47.043456 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823f4c3-3bfe-433b-b133-d40434d4f00a service swift] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:47.126949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:47.128630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.134725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.134725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] PATH_INFO: `/v3/projects/114a7d9a1d9340f3aec94ef2334fc118` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.135747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114a7d9a1d9340f3aec94ef2334fc118)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:47.138536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:47.213534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114a7d9a1d9340f3aec94ef2334fc118', 'request_id': 'req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:47.222546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114a7d9a1d9340f3aec94ef2334fc118', 'request_id': 'req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:47.237486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114a7d9a1d9340f3aec94ef2334fc118', 'request_id': 'req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:47.270325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] The token cache is being invalidate because project 114a7d9a1d9340f3aec94ef2334fc118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:47.270856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:47.272637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0ce4eb41-10a8-4de6-a4f9-270dcdc97df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:47.275135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1121/2236] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:47 2021] DELETE /identity/v3/projects/114a7d9a1d9340f3aec94ef2334fc118 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:47.282520 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fefa-d530-43aa-a386-e91f72effe0e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.283307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fefa-d530-43aa-a386-e91f72effe0e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.283465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fefa-d530-43aa-a386-e91f72effe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.321130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e276fefa-d530-43aa-a386-e91f72effe0e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:47.323368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e276fefa-d530-43aa-a386-e91f72effe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:47.414637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1116/2237] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:47.423107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7d77-663f-43de-9843-d28a42b263d9 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.423628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7d77-663f-43de-9843-d28a42b263d9 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.424049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7d77-663f-43de-9843-d28a42b263d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.453545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-abae7d77-663f-43de-9843-d28a42b263d9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:47.455577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-abae7d77-663f-43de-9843-d28a42b263d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:47.470776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1122/2238] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:47.478354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276fefa-d530-43aa-a386-e91f72effe0e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:47.494960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276fefa-d530-43aa-a386-e91f72effe0e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:47.502959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:47.504318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.504804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.505262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.506707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:47.507225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:47.510126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:47.529569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1117/2239] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:47.542352 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7d77-663f-43de-9843-d28a42b263d9 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:47.557072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7d77-663f-43de-9843-d28a42b263d9 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:47.565415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f9e22-9a4d-4bd3-bdc2-8b7df1249a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:47.566577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9e22-9a4d-4bd3-bdc2-8b7df1249a3b admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.567167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9e22-9a4d-4bd3-bdc2-8b7df1249a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.567747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9e22-9a4d-4bd3-bdc2-8b7df1249a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.569236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f9e22-9a4d-4bd3-bdc2-8b7df1249a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:47.573133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f9e22-9a4d-4bd3-bdc2-8b7df1249a3b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:47.627137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1123/2240] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:47 2021] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:47.634140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:47.648847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00523026-f8b4-4071-84ee-2b6197ff3abb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:47.739514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bef5ae-e425-4bbb-bc4d-d307da58bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:47.740373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bef5ae-e425-4bbb-bc4d-d307da58bb8e admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.740797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bef5ae-e425-4bbb-bc4d-d307da58bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.741174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bef5ae-e425-4bbb-bc4d-d307da58bb8e admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.741945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bef5ae-e425-4bbb-bc4d-d307da58bb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:47.744175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bef5ae-e425-4bbb-bc4d-d307da58bb8e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:47.775704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1118/2241] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:47 2021] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:47.781952 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f9e22-9a4d-4bd3-bdc2-8b7df1249a3b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:47.801459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f9e22-9a4d-4bd3-bdc2-8b7df1249a3b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:47.809557 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75cf1-27b1-418f-9099-99f2cbc29e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:47.810635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75cf1-27b1-418f-9099-99f2cbc29e12 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.811137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75cf1-27b1-418f-9099-99f2cbc29e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.811630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75cf1-27b1-418f-9099-99f2cbc29e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.812941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d75cf1-27b1-418f-9099-99f2cbc29e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:47.816327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d75cf1-27b1-418f-9099-99f2cbc29e12 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:47.838912 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1124/2242] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:59:47.844888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bef5ae-e425-4bbb-bc4d-d307da58bb8e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:47.861223 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bef5ae-e425-4bbb-bc4d-d307da58bb8e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:47.870559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e39a4-efad-456d-be52-08f42c97d545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:47.871560 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e39a4-efad-456d-be52-08f42c97d545 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.872135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e39a4-efad-456d-be52-08f42c97d545 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.872634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e39a4-efad-456d-be52-08f42c97d545 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.874175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e39a4-efad-456d-be52-08f42c97d545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:47.880336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e39a4-efad-456d-be52-08f42c97d545 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:47.916456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1119/2243] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 14:59:47.919032 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75cf1-27b1-418f-9099-99f2cbc29e12 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:47.939307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75cf1-27b1-418f-9099-99f2cbc29e12 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:47.948800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:47.950270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:47.950809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:47.951302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] PATH_INFO: `/v3/projects/6161e2ac42c24a0b979148c009204eb4/users/8a05b043281f4541b6866e27c3ec1681/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:47.991953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6161e2ac42c24a0b979148c009204eb4, user_id=8a05b043281f4541b6866e27c3ec1681, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:47.997956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:48.024795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1125/2244] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:47 2021] PUT /identity/v3/projects/6161e2ac42c24a0b979148c009204eb4/users/8a05b043281f4541b6866e27c3ec1681/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:48.041958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0dce-6333-431a-bfa4-1cc2dd576f73 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:48.042347 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0dce-6333-431a-bfa4-1cc2dd576f73 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:48.042715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0dce-6333-431a-bfa4-1cc2dd576f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:48.095480 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-1cbc0dce-6333-431a-bfa4-1cc2dd576f73 None None] MFA Rules not processed for user `8a05b043281f4541b6866e27c3ec1681`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:48.097527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1cbc0dce-6333-431a-bfa4-1cc2dd576f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:48.198325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1120/2245] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:48 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:48.211950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:48.215297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:48.353177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372af48-cdd6-4040-9cf4-51d25cf44be8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:48.361200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92f456ee8cf4564aaca2b16f320b49d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:48.363644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:48.363644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:48.364097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:48.391213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:48.393948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:48.412262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1126/2246] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:48 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:59:52.260173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc0dce-6333-431a-bfa4-1cc2dd576f73 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:52.262491 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1cbc0dce-6333-431a-bfa4-1cc2dd576f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:52.486923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc0dce-6333-431a-bfa4-1cc2dd576f73 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:52.494173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:52.495600 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:52.496111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:52.496581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] PATH_INFO: `/v3/users/70efd41a98c644ccab8b9de51b9454c1` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:52.500270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=70efd41a98c644ccab8b9de51b9454c1)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:52.505193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:52.624961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:52.627537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:52.638373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70efd41a98c644ccab8b9de51b9454c1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.651690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70efd41a98c644ccab8b9de51b9454c1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.652605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c464d3-f436-4906-9bbe-a4c4c7d4e4b9 service glance] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:52.652691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70efd41a98c644ccab8b9de51b9454c1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.653903 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70efd41a98c644ccab8b9de51b9454c1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.673973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-151a8e58-1734-4b47-83eb-28c16eaf8f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70efd41a98c644ccab8b9de51b9454c1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.679941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:52.682200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:52.683092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:52.685866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] PATH_INFO: `/v3/users/51aca3a2758d4c74bcb9937caab6c691` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:52.697406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51aca3a2758d4c74bcb9937caab6c691)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:52.697681 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1121/2247] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:52 2021] DELETE /identity/v3/users/70efd41a98c644ccab8b9de51b9454c1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:52.703102 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:52.704287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec334c-6cd5-4f25-bbd0-e86523be56db None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:52.704657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec334c-6cd5-4f25-bbd0-e86523be56db None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:52.705287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec334c-6cd5-4f25-bbd0-e86523be56db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:52.736761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0fec334c-6cd5-4f25-bbd0-e86523be56db None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:52.738129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0fec334c-6cd5-4f25-bbd0-e86523be56db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:52.852037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51aca3a2758d4c74bcb9937caab6c691'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.869311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51aca3a2758d4c74bcb9937caab6c691'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.870234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51aca3a2758d4c74bcb9937caab6c691'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.871323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51aca3a2758d4c74bcb9937caab6c691'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.908542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-7dd89c4e-1644-4198-8269-258964603bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51aca3a2758d4c74bcb9937caab6c691'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:52.911528 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1122/2248] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 14:59:52.925778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec334c-6cd5-4f25-bbd0-e86523be56db None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:52.936914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0fec334c-6cd5-4f25-bbd0-e86523be56db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:52.955890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1127/2249] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:52 2021] DELETE /identity/v3/users/51aca3a2758d4c74bcb9937caab6c691 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:52.959155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7de6a-6804-45f4-b469-4a665d50982c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:52.959641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7de6a-6804-45f4-b469-4a665d50982c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:52.959980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7de6a-6804-45f4-b469-4a665d50982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:52.987909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f0f7de6a-6804-45f4-b469-4a665d50982c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:52.989434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f0f7de6a-6804-45f4-b469-4a665d50982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:53.062731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec334c-6cd5-4f25-bbd0-e86523be56db None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:53.081895 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1128/2250] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:53.102104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7de6a-6804-45f4-b469-4a665d50982c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:53.150340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:53.150856 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:53.151738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:53.151738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:53.162639 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:53.164091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:53.175479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1123/2251] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:53.194479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7de6a-6804-45f4-b469-4a665d50982c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:53.198523 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137592e-90bf-478b-8bd6-715e039b05fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:53.199130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137592e-90bf-478b-8bd6-715e039b05fc service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:53.199416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137592e-90bf-478b-8bd6-715e039b05fc service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:53.199699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137592e-90bf-478b-8bd6-715e039b05fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:53.210566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137592e-90bf-478b-8bd6-715e039b05fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:53.212033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137592e-90bf-478b-8bd6-715e039b05fc service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:53.222713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1129/2252] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 14:59:53.664154 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:53.668009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:53.696220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0180115-e722-44e7-9ec1-ba2241c797d9 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:53.704718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:53.706360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:53.706360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:53.706360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] PATH_INFO: `/v3/projects/1bda41a63b28467cb60de8010e02c23d` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:53.707886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bda41a63b28467cb60de8010e02c23d)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:53.710914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:53.789846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bda41a63b28467cb60de8010e02c23d', 'request_id': 'req-48a3d04f-599a-457c-b137-760dbd801bfa'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:53.820194 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bda41a63b28467cb60de8010e02c23d', 'request_id': 'req-48a3d04f-599a-457c-b137-760dbd801bfa'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:53.839817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bda41a63b28467cb60de8010e02c23d', 'request_id': 'req-48a3d04f-599a-457c-b137-760dbd801bfa'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:53.913182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] The token cache is being invalidate because project 1bda41a63b28467cb60de8010e02c23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:53.913182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:53.916136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:53.933194 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1124/2253] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:53 2021] DELETE /identity/v3/projects/1bda41a63b28467cb60de8010e02c23d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:53.942706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32231806-f505-41c1-9f33-4ed94bceb76a None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:53.944050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32231806-f505-41c1-9f33-4ed94bceb76a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:53.944895 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32231806-f505-41c1-9f33-4ed94bceb76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:53.949630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:53.956764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:54.039919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-32231806-f505-41c1-9f33-4ed94bceb76a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:54.042001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-32231806-f505-41c1-9f33-4ed94bceb76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:54.199858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d04f-599a-457c-b137-760dbd801bfa admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:54.200899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:54.201732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:54.202031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:54.202298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] PATH_INFO: `/v3/projects/1a35a8f34ccd4f299e70454da54deed0` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:54.210324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a35a8f34ccd4f299e70454da54deed0)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:54.210573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1130/2254] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:54.210688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:54.213089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a824-7e57-471a-887c-acc8ee824fc8 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:54.213746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a824-7e57-471a-887c-acc8ee824fc8 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:54.214246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a824-7e57-471a-887c-acc8ee824fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:54.249143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2d67a824-7e57-471a-887c-acc8ee824fc8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:54.251883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2d67a824-7e57-471a-887c-acc8ee824fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:54.272572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1131/2255] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:54.274976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67a824-7e57-471a-887c-acc8ee824fc8 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:54.279326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a35a8f34ccd4f299e70454da54deed0', 'request_id': 'req-ca932ca4-0720-4702-bf64-74478b390995'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.288185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a35a8f34ccd4f299e70454da54deed0', 'request_id': 'req-ca932ca4-0720-4702-bf64-74478b390995'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.291967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67a824-7e57-471a-887c-acc8ee824fc8 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:54.305041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a35a8f34ccd4f299e70454da54deed0', 'request_id': 'req-ca932ca4-0720-4702-bf64-74478b390995'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.335415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] The token cache is being invalidate because project 1a35a8f34ccd4f299e70454da54deed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:54.336036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.348551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.352675 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1125/2256] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:53 2021] DELETE /identity/v3/projects/1a35a8f34ccd4f299e70454da54deed0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:54.358822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:54.361171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:54.437723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:54.439925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:54.440661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:54.441061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:54.442261 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:54.443347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:54.446312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:54.475259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1132/2257] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 14:59:54.484836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:54.488495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:54.510932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55e03d-bd9e-40e4-95a6-c051c104cc14 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:54.524955 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cedf58-2b61-48ed-930f-cbb5c9807996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:54.527146 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cedf58-2b61-48ed-930f-cbb5c9807996 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:54.527811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cedf58-2b61-48ed-930f-cbb5c9807996 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:54.528528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cedf58-2b61-48ed-930f-cbb5c9807996 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:54.530524 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cedf58-2b61-48ed-930f-cbb5c9807996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:54.533357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cedf58-2b61-48ed-930f-cbb5c9807996 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:54.536662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932ca4-0720-4702-bf64-74478b390995 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:54.542319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:54.543194 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:54.543479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:54.543765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] PATH_INFO: `/v3/users/47b82b58a67d4054b075a0df0b090b94` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:54.545338 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b82b58a67d4054b075a0df0b090b94)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:54.547757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:54.592911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1133/2258] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:54 2021] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:54.598277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cedf58-2b61-48ed-930f-cbb5c9807996 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:54.641775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b82b58a67d4054b075a0df0b090b94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.655813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b82b58a67d4054b075a0df0b090b94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.656952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b82b58a67d4054b075a0df0b090b94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.657923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b82b58a67d4054b075a0df0b090b94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.674533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b82b58a67d4054b075a0df0b090b94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:54.717349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1126/2259] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 14:59:54 2021] DELETE /identity/v3/users/47b82b58a67d4054b075a0df0b090b94 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:54.727379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cedf58-2b61-48ed-930f-cbb5c9807996 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:54.893136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306bceb-fa0d-40b5-a8a0-698a04e1e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:54.894129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306bceb-fa0d-40b5-a8a0-698a04e1e62d admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:54.894601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306bceb-fa0d-40b5-a8a0-698a04e1e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:54.895091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306bceb-fa0d-40b5-a8a0-698a04e1e62d admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:54.896348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306bceb-fa0d-40b5-a8a0-698a04e1e62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:54.899969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306bceb-fa0d-40b5-a8a0-698a04e1e62d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:54.935965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1134/2260] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:54 2021] POST /identity/v3/users => generated 287 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:54.940650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:54.942115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:54.959092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bf79e-77ca-4b7f-b6ce-e727c02a48bf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:54.967173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65c1e-673c-4463-8b70-cbf0737cb40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:54.968296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65c1e-673c-4463-8b70-cbf0737cb40c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:54.968775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65c1e-673c-4463-8b70-cbf0737cb40c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:54.969322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65c1e-673c-4463-8b70-cbf0737cb40c admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:54.971884 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65c1e-673c-4463-8b70-cbf0737cb40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:54.975896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65c1e-673c-4463-8b70-cbf0737cb40c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:55.001582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1127/2261] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:54 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:55.003282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306bceb-fa0d-40b5-a8a0-698a04e1e62d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:55.015909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306bceb-fa0d-40b5-a8a0-698a04e1e62d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:55.023439 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d6a0-bbdd-490c-9b30-cbae59ea3ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:55.024745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d6a0-bbdd-490c-9b30-cbae59ea3ecb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:55.025147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d6a0-bbdd-490c-9b30-cbae59ea3ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:55.025707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d6a0-bbdd-490c-9b30-cbae59ea3ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:55.027095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d6a0-bbdd-490c-9b30-cbae59ea3ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:55.030087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d6a0-bbdd-490c-9b30-cbae59ea3ecb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:55.051302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1135/2262] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:55 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:55.057395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65c1e-673c-4463-8b70-cbf0737cb40c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:55.072030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65c1e-673c-4463-8b70-cbf0737cb40c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:55.080149 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:55.080485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:55.080809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:55.081153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] PATH_INFO: `/v3/projects/851559b5d43e474aa0fb5071883e75fb/users/3aee7075283f455ebb1693f09ecd276e/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:55.111511 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] RBAC: Authorizing `identity:create_grant(project_id=851559b5d43e474aa0fb5071883e75fb, user_id=3aee7075283f455ebb1693f09ecd276e, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:55.116804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:55.139215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1128/2263] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:55 2021] PUT /identity/v3/projects/851559b5d43e474aa0fb5071883e75fb/users/3aee7075283f455ebb1693f09ecd276e/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:55.145397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298bb54-dcfc-48f9-9bba-f9afb8d7a22d None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:55.145938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298bb54-dcfc-48f9-9bba-f9afb8d7a22d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:55.146663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298bb54-dcfc-48f9-9bba-f9afb8d7a22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:55.174121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e298bb54-dcfc-48f9-9bba-f9afb8d7a22d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:55.174879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e298bb54-dcfc-48f9-9bba-f9afb8d7a22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:55.283428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1136/2264] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:55.299394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:55.301922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:55.447855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9944-e6fd-4243-bedf-6e1748b360df admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:55.452808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d79d3f-07c5-4935-aa36-119125abb5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:55.454108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79d3f-07c5-4935-aa36-119125abb5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:55.454320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79d3f-07c5-4935-aa36-119125abb5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:55.454710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79d3f-07c5-4935-aa36-119125abb5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:55.480820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d79d3f-07c5-4935-aa36-119125abb5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:55.484443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d79d3f-07c5-4935-aa36-119125abb5f4 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:55.508250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1129/2265] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 14:59:55.548608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298bb54-dcfc-48f9-9bba-f9afb8d7a22d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:55.550964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e298bb54-dcfc-48f9-9bba-f9afb8d7a22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:55.567217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298bb54-dcfc-48f9-9bba-f9afb8d7a22d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:55.575170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:55.576434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:55.576931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:55.577445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] PATH_INFO: `/v3/projects/17f1c6a0b654457ab5205a5d7e124496` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:55.579571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f1c6a0b654457ab5205a5d7e124496)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:55.583973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:55.705609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f1c6a0b654457ab5205a5d7e124496', 'request_id': 'req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:55.719565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f1c6a0b654457ab5205a5d7e124496', 'request_id': 'req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:55.736178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f1c6a0b654457ab5205a5d7e124496', 'request_id': 'req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:55.767994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] The token cache is being invalidate because project 17f1c6a0b654457ab5205a5d7e124496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 14:59:55.768275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:55.769291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-56c4fed9-ed8b-4add-a3ec-5b1f36bf9eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 14:59:55.772247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1137/2266] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 14:59:55 2021] DELETE /identity/v3/projects/17f1c6a0b654457ab5205a5d7e124496 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 14:59:55.780325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644b54-fcdd-4ef3-8a9e-a35624db911d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:55.781187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644b54-fcdd-4ef3-8a9e-a35624db911d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:55.781341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644b54-fcdd-4ef3-8a9e-a35624db911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:55.836224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0b644b54-fcdd-4ef3-8a9e-a35624db911d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:55.838858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0b644b54-fcdd-4ef3-8a9e-a35624db911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:55.962601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1130/2267] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:55.971730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c25c-175e-4da3-8dd9-dca0508b1828 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:55.972027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c25c-175e-4da3-8dd9-dca0508b1828 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:55.972300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c25c-175e-4da3-8dd9-dca0508b1828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:56.004258 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-af56c25c-175e-4da3-8dd9-dca0508b1828 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:56.005988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-af56c25c-175e-4da3-8dd9-dca0508b1828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:56.018158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1138/2268] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:56.024397 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b644b54-fcdd-4ef3-8a9e-a35624db911d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:56.041574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b644b54-fcdd-4ef3-8a9e-a35624db911d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:56.053306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:56.054383 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:56.054917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:56.055424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:56.057003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 14:59:56.057587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:56.061793 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:56.086139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1131/2269] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 14:59:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 14:59:56.092721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c25c-175e-4da3-8dd9-dca0508b1828 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:56.110227 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c25c-175e-4da3-8dd9-dca0508b1828 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:56.119377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee18d3-f921-4f22-a95b-e9a6742409e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:56.120401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee18d3-f921-4f22-a95b-e9a6742409e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:56.120905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee18d3-f921-4f22-a95b-e9a6742409e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:56.121381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee18d3-f921-4f22-a95b-e9a6742409e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:56.122631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee18d3-f921-4f22-a95b-e9a6742409e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:56.126537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee18d3-f921-4f22-a95b-e9a6742409e7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:56.182267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1139/2270] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 14:59:56 2021] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 14:59:56.184162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:56.218693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54278ec1-5ac0-49ae-9358-2cefeb8b87d5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:56.390665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9e7e-862a-4372-817c-a6ad8c2c37d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:56.391634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9e7e-862a-4372-817c-a6ad8c2c37d0 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:56.392115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9e7e-862a-4372-817c-a6ad8c2c37d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:56.392583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9e7e-862a-4372-817c-a6ad8c2c37d0 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:56.393766 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d9e7e-862a-4372-817c-a6ad8c2c37d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:56.399001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d9e7e-862a-4372-817c-a6ad8c2c37d0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:56.448662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1132/2271] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 14:59:56 2021] POST /identity/v3/users => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 14:59:56.457446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee18d3-f921-4f22-a95b-e9a6742409e7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:56.473415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee18d3-f921-4f22-a95b-e9a6742409e7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:56.482325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebcd6f-010e-441f-8613-993711aadb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:56.484008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebcd6f-010e-441f-8613-993711aadb02 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:56.484583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebcd6f-010e-441f-8613-993711aadb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:56.485183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebcd6f-010e-441f-8613-993711aadb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:56.486240 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebcd6f-010e-441f-8613-993711aadb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:56.488982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebcd6f-010e-441f-8613-993711aadb02 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:56.504768 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1140/2272] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:56 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:56.509847 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9e7e-862a-4372-817c-a6ad8c2c37d0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:56.524360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9e7e-862a-4372-817c-a6ad8c2c37d0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:56.550973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372b692-5446-480d-8327-12d3bc58a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:56.553929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372b692-5446-480d-8327-12d3bc58a308 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:56.554685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372b692-5446-480d-8327-12d3bc58a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:56.558640 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372b692-5446-480d-8327-12d3bc58a308 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:56.563004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372b692-5446-480d-8327-12d3bc58a308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:56.564771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372b692-5446-480d-8327-12d3bc58a308 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:56.578472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1133/2273] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 14:59:56 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 14:59:56.581666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebcd6f-010e-441f-8613-993711aadb02 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:56.593224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebcd6f-010e-441f-8613-993711aadb02 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:56.598611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:56.600217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:56.600502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:56.600779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] PATH_INFO: `/v3/projects/71d588f7d9954f14ba520b598bc50eb3/users/cb96a9b16a324f938069faf45fc0a154/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:56.622170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d588f7d9954f14ba520b598bc50eb3, user_id=cb96a9b16a324f938069faf45fc0a154, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:56.624967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:56.642894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1141/2274] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 14:59:56 2021] PUT /identity/v3/projects/71d588f7d9954f14ba520b598bc50eb3/users/cb96a9b16a324f938069faf45fc0a154/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 14:59:56.655275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a127a4-6c61-4129-b05b-877cb9485e93 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:56.656079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a127a4-6c61-4129-b05b-877cb9485e93 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:56.656642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a127a4-6c61-4129-b05b-877cb9485e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:56.722587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f3a127a4-6c61-4129-b05b-877cb9485e93 None None] MFA Rules not processed for user `cb96a9b16a324f938069faf45fc0a154`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 14:59:56.724667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f3a127a4-6c61-4129-b05b-877cb9485e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:56.963470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1134/2275] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 14:59:56 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 14:59:56.980034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 14:59:56.983018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 14:59:57.171192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7329e-0368-4d94-bbb9-286b148f30bb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 14:59:57.178939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6875e-c575-4ff7-9dcc-7de973b99123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 14:59:57.180448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6875e-c575-4ff7-9dcc-7de973b99123 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 14:59:57.180913 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6875e-c575-4ff7-9dcc-7de973b99123 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 14:59:57.181650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6875e-c575-4ff7-9dcc-7de973b99123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 14:59:57.201325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6875e-c575-4ff7-9dcc-7de973b99123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 14:59:57.204355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6875e-c575-4ff7-9dcc-7de973b99123 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 14:59:57.222909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1142/2276] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 14:59:56 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:00:04.882664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a127a4-6c61-4129-b05b-877cb9485e93 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:05.134589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a127a4-6c61-4129-b05b-877cb9485e93 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:05.141454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:05.143272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:05.144175 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:05.144665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] PATH_INFO: `/v3/users/cb96a9b16a324f938069faf45fc0a154` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:05.146877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb96a9b16a324f938069faf45fc0a154)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:05.149440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:05.280331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb96a9b16a324f938069faf45fc0a154'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:05.296756 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb96a9b16a324f938069faf45fc0a154'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:05.299743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb96a9b16a324f938069faf45fc0a154'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:05.300817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb96a9b16a324f938069faf45fc0a154'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:05.320127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb96a9b16a324f938069faf45fc0a154'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:05.369165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3767bf-8308-4f7f-9a2b-fa3f508c6d05 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:05.371269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3767bf-8308-4f7f-9a2b-fa3f508c6d05 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:05.372008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3767bf-8308-4f7f-9a2b-fa3f508c6d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:05.380850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1135/2277] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:00:04 2021] DELETE /identity/v3/users/cb96a9b16a324f938069faf45fc0a154 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:00:05.428627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2d3767bf-8308-4f7f-9a2b-fa3f508c6d05 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:05.431170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2d3767bf-8308-4f7f-9a2b-fa3f508c6d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:05.637972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1143/2278] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:05.654352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:05.661008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:05.848992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035adfc-c5c9-4d13-ab96-5c436623626c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:05.864621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:05.865384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:05.865688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:05.865972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:05.878243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:05.879532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:05.891812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1136/2279] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:00:06.708420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3767bf-8308-4f7f-9a2b-fa3f508c6d05 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:06.710822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2d3767bf-8308-4f7f-9a2b-fa3f508c6d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:06.754932 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3767bf-8308-4f7f-9a2b-fa3f508c6d05 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:06.760433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:06.762894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:06.763437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:06.763986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] PATH_INFO: `/v3/projects/71d588f7d9954f14ba520b598bc50eb3` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:06.765492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d588f7d9954f14ba520b598bc50eb3)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:06.769239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:06.773232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:06.777186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:06.820181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241df6-52e6-4ed6-8a97-7a18117e5871 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:06.841856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d588f7d9954f14ba520b598bc50eb3', 'request_id': 'req-2b99b3f6-fd96-421e-b66a-aa2015ffb841'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:06.848068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d588f7d9954f14ba520b598bc50eb3', 'request_id': 'req-2b99b3f6-fd96-421e-b66a-aa2015ffb841'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:06.880921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d588f7d9954f14ba520b598bc50eb3', 'request_id': 'req-2b99b3f6-fd96-421e-b66a-aa2015ffb841'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:06.904365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] The token cache is being invalidate because project 71d588f7d9954f14ba520b598bc50eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:00:06.904685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:06.905362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2b99b3f6-fd96-421e-b66a-aa2015ffb841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:06.914344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1144/2280] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:00:06 2021] DELETE /identity/v3/projects/71d588f7d9954f14ba520b598bc50eb3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:06.915880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6885-64e3-4745-b7dd-bbeb3c8dc7e2 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:06.916173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6885-64e3-4745-b7dd-bbeb3c8dc7e2 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:06.916453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6885-64e3-4745-b7dd-bbeb3c8dc7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:06.945894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-bafc6885-64e3-4745-b7dd-bbeb3c8dc7e2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:06.947186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bafc6885-64e3-4745-b7dd-bbeb3c8dc7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:07.051075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1145/2281] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:07.059961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697fca-f7d2-43e8-8d1d-1690d68cd583 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.060749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697fca-f7d2-43e8-8d1d-1690d68cd583 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.060749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697fca-f7d2-43e8-8d1d-1690d68cd583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.078181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.079550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.080068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.080461 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] PATH_INFO: `/v3/users/0ac06befaeef4e959f7872446d776ca6` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.082396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac06befaeef4e959f7872446d776ca6)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.086332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.102276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-09697fca-f7d2-43e8-8d1d-1690d68cd583 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:07.103615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-09697fca-f7d2-43e8-8d1d-1690d68cd583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:07.122455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1146/2282] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:07.122949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09697fca-f7d2-43e8-8d1d-1690d68cd583 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.144662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09697fca-f7d2-43e8-8d1d-1690d68cd583 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:07.146657 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.147445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.147810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.148236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.149010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:00:07.149478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.151453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.175959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac06befaeef4e959f7872446d776ca6'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:07.178646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1147/2283] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:00:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:00:07.181270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.185064 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac06befaeef4e959f7872446d776ca6'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:07.185871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac06befaeef4e959f7872446d776ca6'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:07.186604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac06befaeef4e959f7872446d776ca6'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:07.196773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0c90ed6a-d05d-4653-ad20-249a54a8408d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac06befaeef4e959f7872446d776ca6'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:07.199701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fdebf-34a4-4fec-9a70-f9d8541cb866 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:07.207305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.208926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.209444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.209949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.211789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.214828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.222782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1137/2284] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:00:06 2021] DELETE /identity/v3/users/0ac06befaeef4e959f7872446d776ca6 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:07.228416 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1fab4-4292-400e-8e55-9041ab607168 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.228845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1fab4-4292-400e-8e55-9041ab607168 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.229362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1fab4-4292-400e-8e55-9041ab607168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.261174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-3bb1fab4-4292-400e-8e55-9041ab607168 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:07.263109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-3bb1fab4-4292-400e-8e55-9041ab607168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:07.273986 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1148/2285] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:00:07 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:00:07.279600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.281508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:07.376179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178611-1eec-4f61-a50d-791ff6594eb0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:07.384171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238617c2-b991-466a-9eba-0af7f455f23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.384994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238617c2-b991-466a-9eba-0af7f455f23e admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.385470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238617c2-b991-466a-9eba-0af7f455f23e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.385911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238617c2-b991-466a-9eba-0af7f455f23e admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.386973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238617c2-b991-466a-9eba-0af7f455f23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.389744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238617c2-b991-466a-9eba-0af7f455f23e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.426690 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1149/2286] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:00:07 2021] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:00:07.426989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238617c2-b991-466a-9eba-0af7f455f23e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.438193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1138/2287] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:07.456022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65910-62ec-4201-8d7d-7c0e8f63011c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.456401 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65910-62ec-4201-8d7d-7c0e8f63011c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.456568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65910-62ec-4201-8d7d-7c0e8f63011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.460772 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238617c2-b991-466a-9eba-0af7f455f23e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:07.466841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.467766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.468246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.468710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.469980 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.472494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.487073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1150/2288] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:07 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:00:07.488288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.497072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:07.511092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d4d65910-62ec-4201-8d7d-7c0e8f63011c None None] MFA Rules not processed for user `3aee7075283f455ebb1693f09ecd276e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:07.512299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d4d65910-62ec-4201-8d7d-7c0e8f63011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:07.584423 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e271e-fab9-405c-a73a-446181a51c02 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:07.588498 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8996e4-6b74-4c1d-9172-780cd6929cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.589182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8996e4-6b74-4c1d-9172-780cd6929cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.589563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8996e4-6b74-4c1d-9172-780cd6929cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.589908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8996e4-6b74-4c1d-9172-780cd6929cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.600218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8996e4-6b74-4c1d-9172-780cd6929cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.601805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8996e4-6b74-4c1d-9172-780cd6929cc0 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.613323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1151/2289] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:00:07.623713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1139/2290] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:07 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:07.624564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8996e4-6b74-4c1d-9172-780cd6929cc0 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.626428 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65910-62ec-4201-8d7d-7c0e8f63011c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.631431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d4d65910-62ec-4201-8d7d-7c0e8f63011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:07.646718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8996e4-6b74-4c1d-9172-780cd6929cc0 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:07.649537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65910-62ec-4201-8d7d-7c0e8f63011c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:07.654578 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127587a1-68b2-4c4c-b63a-030d29734188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.655794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127587a1-68b2-4c4c-b63a-030d29734188 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.656406 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127587a1-68b2-4c4c-b63a-030d29734188 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.656956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127587a1-68b2-4c4c-b63a-030d29734188 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.658437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127587a1-68b2-4c4c-b63a-030d29734188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.661941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127587a1-68b2-4c4c-b63a-030d29734188 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.667517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160a06e-f0af-442a-9891-b41bfecb16e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.668528 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160a06e-f0af-442a-9891-b41bfecb16e8 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.669008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160a06e-f0af-442a-9891-b41bfecb16e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.669505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160a06e-f0af-442a-9891-b41bfecb16e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.670333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160a06e-f0af-442a-9891-b41bfecb16e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.672536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160a06e-f0af-442a-9891-b41bfecb16e8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.690590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1152/2291] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:07 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:00:07.702151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127587a1-68b2-4c4c-b63a-030d29734188 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.724271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127587a1-68b2-4c4c-b63a-030d29734188 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:07.736818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1140/2292] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:00:07 2021] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:00:07.737078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa5f65-3d37-4b69-b4ae-245c86ce3055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:07.737078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa5f65-3d37-4b69-b4ae-245c86ce3055 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.737280 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160a06e-f0af-442a-9891-b41bfecb16e8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:07.737582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa5f65-3d37-4b69-b4ae-245c86ce3055 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.738211 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa5f65-3d37-4b69-b4ae-245c86ce3055 admin admin] PATH_INFO: `/v3/projects/3e67a2e47e9b4189b5270beff7f12aaa/users/a1cbfc1dd41544d39c935a6a0dd4be2b/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.792066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa5f65-3d37-4b69-b4ae-245c86ce3055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e67a2e47e9b4189b5270beff7f12aaa, user_id=a1cbfc1dd41544d39c935a6a0dd4be2b, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:07.803944 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa5f65-3d37-4b69-b4ae-245c86ce3055 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:07.842872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1153/2293] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:00:07 2021] PUT /identity/v3/projects/3e67a2e47e9b4189b5270beff7f12aaa/users/a1cbfc1dd41544d39c935a6a0dd4be2b/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:07.849087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e985-417a-4337-9f58-07c611e084b4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:07.849398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e985-417a-4337-9f58-07c611e084b4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:07.849643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e985-417a-4337-9f58-07c611e084b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:07.900019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1704e985-417a-4337-9f58-07c611e084b4 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:07.901167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1704e985-417a-4337-9f58-07c611e084b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:07.928757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160a06e-f0af-442a-9891-b41bfecb16e8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:08.069685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1154/2294] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:00:08.083943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e985-417a-4337-9f58-07c611e084b4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:08.086293 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1704e985-417a-4337-9f58-07c611e084b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:08.114741 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6ef62-637d-4447-8533-24653242035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:08.115405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6ef62-637d-4447-8533-24653242035d admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:08.115696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6ef62-637d-4447-8533-24653242035d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:08.116008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6ef62-637d-4447-8533-24653242035d admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:08.116707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6ef62-637d-4447-8533-24653242035d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:08.118699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6ef62-637d-4447-8533-24653242035d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:08.147438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1141/2295] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:00:07 2021] POST /identity/v3/users => generated 292 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:00:08.149032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6ef62-637d-4447-8533-24653242035d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:08.163260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6ef62-637d-4447-8533-24653242035d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:08.168712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadede45-4f09-431f-81fa-c0db3ea4ecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:08.169346 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadede45-4f09-431f-81fa-c0db3ea4ecf7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:08.169637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadede45-4f09-431f-81fa-c0db3ea4ecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:08.169918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadede45-4f09-431f-81fa-c0db3ea4ecf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:08.170683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadede45-4f09-431f-81fa-c0db3ea4ecf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:08.174552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadede45-4f09-431f-81fa-c0db3ea4ecf7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:08.190507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1142/2296] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:08 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:00:08.199326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadede45-4f09-431f-81fa-c0db3ea4ecf7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:08.213924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadede45-4f09-431f-81fa-c0db3ea4ecf7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:08.221160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716250a0-9af6-473b-8c36-6e18df9f8613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:08.222114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716250a0-9af6-473b-8c36-6e18df9f8613 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:08.222854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716250a0-9af6-473b-8c36-6e18df9f8613 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:08.223049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716250a0-9af6-473b-8c36-6e18df9f8613 admin admin] PATH_INFO: `/v3/projects/e903acece5ae4712953c2923906051d6/users/6446c590390540b19f1ba4a0c5320ad9/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:08.244688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e985-417a-4337-9f58-07c611e084b4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:08.255708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786743c8-c25e-4587-ae54-8b21c54ece30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:08.255708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786743c8-c25e-4587-ae54-8b21c54ece30 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:08.256636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786743c8-c25e-4587-ae54-8b21c54ece30 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:08.257048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786743c8-c25e-4587-ae54-8b21c54ece30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:08.265607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716250a0-9af6-473b-8c36-6e18df9f8613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e903acece5ae4712953c2923906051d6, user_id=6446c590390540b19f1ba4a0c5320ad9, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:08.272176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716250a0-9af6-473b-8c36-6e18df9f8613 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:08.280194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786743c8-c25e-4587-ae54-8b21c54ece30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:08.282449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786743c8-c25e-4587-ae54-8b21c54ece30 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:08.295652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1155/2297] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:00:08.306354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1143/2298] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:00:08 2021] PUT /identity/v3/projects/e903acece5ae4712953c2923906051d6/users/6446c590390540b19f1ba4a0c5320ad9/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:08.310087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786743c8-c25e-4587-ae54-8b21c54ece30 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:08.330779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786743c8-c25e-4587-ae54-8b21c54ece30 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:08.420111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:08.420929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:08.421291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:08.421664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:08.422342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:08.424356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:08.442308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1156/2299] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:08 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:00:08.443549 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716250a0-9af6-473b-8c36-6e18df9f8613 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:08.463183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716250a0-9af6-473b-8c36-6e18df9f8613 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:08.472009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38409d-fd6b-4795-b5f8-dcec64a357f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:08.474181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38409d-fd6b-4795-b5f8-dcec64a357f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:08.474739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38409d-fd6b-4795-b5f8-dcec64a357f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:08.475226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38409d-fd6b-4795-b5f8-dcec64a357f7 admin admin] PATH_INFO: `/v3/projects/e903acece5ae4712953c2923906051d6/users/6446c590390540b19f1ba4a0c5320ad9/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:08.479055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38409d-fd6b-4795-b5f8-dcec64a357f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e903acece5ae4712953c2923906051d6, user_id=6446c590390540b19f1ba4a0c5320ad9, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:08.485254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38409d-fd6b-4795-b5f8-dcec64a357f7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:08.538145 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1144/2300] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:00:08 2021] PUT /identity/v3/projects/e903acece5ae4712953c2923906051d6/users/6446c590390540b19f1ba4a0c5320ad9/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:08.607974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:08.615704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:08.642447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eaaca-b038-4f2f-8f3d-bfc5bd2edf7d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:08.813537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:08.815118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:08.815763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:08.816452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] PATH_INFO: `/v3/projects/be666016093847b8adadfcf1ab24f08e` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:08.823036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be666016093847b8adadfcf1ab24f08e)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:08.832480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:09.078438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be666016093847b8adadfcf1ab24f08e', 'request_id': 'req-e583c3a8-467b-4217-bebe-8c2e7602ac8e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:09.089497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be666016093847b8adadfcf1ab24f08e', 'request_id': 'req-e583c3a8-467b-4217-bebe-8c2e7602ac8e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:09.107283 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be666016093847b8adadfcf1ab24f08e', 'request_id': 'req-e583c3a8-467b-4217-bebe-8c2e7602ac8e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:09.132335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] The token cache is being invalidate because project be666016093847b8adadfcf1ab24f08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:00:09.132933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:09.133871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e583c3a8-467b-4217-bebe-8c2e7602ac8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:09.135612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1157/2301] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:00:08 2021] DELETE /identity/v3/projects/be666016093847b8adadfcf1ab24f08e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:09.144638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095622-334e-4fc8-be00-acf38636b865 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:09.146195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095622-334e-4fc8-be00-acf38636b865 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:09.147619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095622-334e-4fc8-be00-acf38636b865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:09.180079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e9095622-334e-4fc8-be00-acf38636b865 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:09.182535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e9095622-334e-4fc8-be00-acf38636b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:09.288230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1145/2302] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:09.296026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383bd3f-9ef1-45aa-b2bf-f828ba167cc5 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:09.296323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383bd3f-9ef1-45aa-b2bf-f828ba167cc5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:09.296605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383bd3f-9ef1-45aa-b2bf-f828ba167cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:09.346584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f383bd3f-9ef1-45aa-b2bf-f828ba167cc5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:09.347871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f383bd3f-9ef1-45aa-b2bf-f828ba167cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:09.371152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1158/2303] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:09.373631 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095622-334e-4fc8-be00-acf38636b865 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:09.386978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095622-334e-4fc8-be00-acf38636b865 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:09.400186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:09.400815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:09.401487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:09.402226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:09.403085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:00:09.404402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:09.407342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:09.446807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1146/2304] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:00:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:00:09.451742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383bd3f-9ef1-45aa-b2bf-f828ba167cc5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:09.464255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383bd3f-9ef1-45aa-b2bf-f828ba167cc5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:09.479280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ced88-1683-42bf-bf4e-df81b77f5a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:09.480564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ced88-1683-42bf-bf4e-df81b77f5a38 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:09.480564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ced88-1683-42bf-bf4e-df81b77f5a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:09.480785 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ced88-1683-42bf-bf4e-df81b77f5a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:09.481364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ced88-1683-42bf-bf4e-df81b77f5a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:09.484731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ced88-1683-42bf-bf4e-df81b77f5a38 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:09.549631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1159/2305] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:00:09 2021] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:00:09.552871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:09.573538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d18946-47e1-42b2-bef8-c98b99632829 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:09.722561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1430a-e3eb-441d-bcab-a4abeb306e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:09.726422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1430a-e3eb-441d-bcab-a4abeb306e78 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:09.728333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1430a-e3eb-441d-bcab-a4abeb306e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:09.729328 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1430a-e3eb-441d-bcab-a4abeb306e78 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:09.732693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1430a-e3eb-441d-bcab-a4abeb306e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:09.742157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1430a-e3eb-441d-bcab-a4abeb306e78 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:09.820680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ced88-1683-42bf-bf4e-df81b77f5a38 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:09.821519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1147/2306] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:00:09 2021] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:00:09.858238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ced88-1683-42bf-bf4e-df81b77f5a38 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:09.877342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664f89-dc18-49b1-adc5-44160504ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:09.878922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664f89-dc18-49b1-adc5-44160504ff9c admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:09.880466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664f89-dc18-49b1-adc5-44160504ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:09.881250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664f89-dc18-49b1-adc5-44160504ff9c admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:09.888416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb664f89-dc18-49b1-adc5-44160504ff9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:09.892911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb664f89-dc18-49b1-adc5-44160504ff9c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:09.951375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1160/2307] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:09 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:00:09.954748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1430a-e3eb-441d-bcab-a4abeb306e78 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:09.967386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1430a-e3eb-441d-bcab-a4abeb306e78 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:10.007390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f8103-d224-4f79-8a08-5f237e4897f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:10.008044 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8103-d224-4f79-8a08-5f237e4897f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:10.009458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8103-d224-4f79-8a08-5f237e4897f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:10.011133 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8103-d224-4f79-8a08-5f237e4897f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:10.011926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f8103-d224-4f79-8a08-5f237e4897f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:10.017268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f8103-d224-4f79-8a08-5f237e4897f4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:10.039659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1148/2308] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:09 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:00:10.044776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664f89-dc18-49b1-adc5-44160504ff9c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:10.082097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664f89-dc18-49b1-adc5-44160504ff9c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:10.112723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:10.115740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:10.116573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:10.120216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] PATH_INFO: `/v3/projects/c6d6beae1f6f41a8b9e25321bc4177ce/users/36c3da1d048e4dffa8da21f21a1721b9/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:10.201323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d6beae1f6f41a8b9e25321bc4177ce, user_id=36c3da1d048e4dffa8da21f21a1721b9, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:10.209238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:10.251054 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1161/2309] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:00:10 2021] PUT /identity/v3/projects/c6d6beae1f6f41a8b9e25321bc4177ce/users/36c3da1d048e4dffa8da21f21a1721b9/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:10.263018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdabbce-27ec-49c8-bd85-f33bcaccf883 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:10.263614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdabbce-27ec-49c8-bd85-f33bcaccf883 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:10.263704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdabbce-27ec-49c8-bd85-f33bcaccf883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:10.354800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ffdabbce-27ec-49c8-bd85-f33bcaccf883 None None] MFA Rules not processed for user `36c3da1d048e4dffa8da21f21a1721b9`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:10.363470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ffdabbce-27ec-49c8-bd85-f33bcaccf883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:10.594163 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1149/2310] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:10 2021] POST /identity/v3/auth/tokens => generated 3704 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:10.855252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:10.857627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:11.094994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca271a69-9576-452d-9a3d-1415ef8e5580 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:11.106225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:11.106874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:11.107433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:11.107721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:11.130997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:11.138693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:11.180603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1162/2311] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:10 2021] GET /identity/v3/auth/tokens => generated 3704 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:00:12.561743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5aa6-6334-4984-b7ec-c97566b185be None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:12.562295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5aa6-6334-4984-b7ec-c97566b185be None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:12.562295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5aa6-6334-4984-b7ec-c97566b185be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:12.610164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-714c5aa6-6334-4984-b7ec-c97566b185be None None] MFA Rules not processed for user `9e0b49f365a542c080e2bdb043dc1387`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:12.611660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-714c5aa6-6334-4984-b7ec-c97566b185be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:12.740030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1150/2312] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:12 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:18.384021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:18.387328 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:18.708368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5b375-2aec-4474-b947-ca0b9de50a6f service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:18.724751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:18.725279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:18.725604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:18.725874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:18.731221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:18.761970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:18.766637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:18.780295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1163/2313] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:18 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:00:21.621049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbd491-196c-4a0e-bb98-dbe3a6edd9df None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:21.622006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbd491-196c-4a0e-bb98-dbe3a6edd9df None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:21.622006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbd491-196c-4a0e-bb98-dbe3a6edd9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:21.697529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-90fbd491-196c-4a0e-bb98-dbe3a6edd9df None None] MFA Rules not processed for user `a1cbfc1dd41544d39c935a6a0dd4be2b`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:21.698970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-90fbd491-196c-4a0e-bb98-dbe3a6edd9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:21.987982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1151/2314] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:21 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:00:21.993694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:22.006871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:22.168443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61c71-a520-4293-aa4e-64978f2ee761 service placement] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:22.185029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbe5cd-4caf-4d35-a9b8-1956166c1f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:22.187497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbe5cd-4caf-4d35-a9b8-1956166c1f41 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:22.188313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbe5cd-4caf-4d35-a9b8-1956166c1f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:22.189018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbe5cd-4caf-4d35-a9b8-1956166c1f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:22.190734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbe5cd-4caf-4d35-a9b8-1956166c1f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:22.197561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbe5cd-4caf-4d35-a9b8-1956166c1f41 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:22.294447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1164/2315] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:00:21 2021] POST /identity/v3/projects => generated 381 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:00:22.300297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbd491-196c-4a0e-bb98-dbe3a6edd9df None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:22.333234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbd491-196c-4a0e-bb98-dbe3a6edd9df None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:22.533479 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5717fc-9df0-44e5-968f-81ce9ac2162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:22.535519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5717fc-9df0-44e5-968f-81ce9ac2162d admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:22.535743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5717fc-9df0-44e5-968f-81ce9ac2162d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:22.536144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5717fc-9df0-44e5-968f-81ce9ac2162d admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:22.538321 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5717fc-9df0-44e5-968f-81ce9ac2162d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:22.542203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5717fc-9df0-44e5-968f-81ce9ac2162d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:22.637536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1152/2316] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:00:22 2021] POST /identity/v3/users => generated 297 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:00:22.644821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbe5cd-4caf-4d35-a9b8-1956166c1f41 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:22.688075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbe5cd-4caf-4d35-a9b8-1956166c1f41 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:22.700458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6027b-a172-4c51-b3b9-bd51553f45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:22.702454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6027b-a172-4c51-b3b9-bd51553f45dd admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:22.703806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6027b-a172-4c51-b3b9-bd51553f45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:22.704655 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6027b-a172-4c51-b3b9-bd51553f45dd admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:22.707165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6027b-a172-4c51-b3b9-bd51553f45dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:22.711297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6027b-a172-4c51-b3b9-bd51553f45dd admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:22.755402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1165/2317] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:22 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:00:22.760284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5717fc-9df0-44e5-968f-81ce9ac2162d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:22.837726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5717fc-9df0-44e5-968f-81ce9ac2162d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:22.852274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ac4c-b750-464d-99f3-cdb247495a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:22.852274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ac4c-b750-464d-99f3-cdb247495a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:22.852769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ac4c-b750-464d-99f3-cdb247495a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:22.852769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ac4c-b750-464d-99f3-cdb247495a0a admin admin] PATH_INFO: `/v3/projects/df4c91d3ef8547ec8f439803e0635458/users/41041e59a6fb422badda5f58d7c615c3/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:22.895079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ac4c-b750-464d-99f3-cdb247495a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4c91d3ef8547ec8f439803e0635458, user_id=41041e59a6fb422badda5f58d7c615c3, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:22.897789 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ac4c-b750-464d-99f3-cdb247495a0a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:22.931824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1153/2318] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:00:22 2021] PUT /identity/v3/projects/df4c91d3ef8547ec8f439803e0635458/users/41041e59a6fb422badda5f58d7c615c3/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:22.937411 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6027b-a172-4c51-b3b9-bd51553f45dd admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:22.998235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6027b-a172-4c51-b3b9-bd51553f45dd admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:23.170304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ac4c-b750-464d-99f3-cdb247495a0a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:23.248238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5193cf-c159-44a1-90f3-09c5d266b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:23.249350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5193cf-c159-44a1-90f3-09c5d266b0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:23.249721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5193cf-c159-44a1-90f3-09c5d266b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:23.250192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5193cf-c159-44a1-90f3-09c5d266b0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:23.252184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5193cf-c159-44a1-90f3-09c5d266b0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:23.256157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5193cf-c159-44a1-90f3-09c5d266b0b7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:23.291071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1166/2319] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:22 2021] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:00:23.294311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5193cf-c159-44a1-90f3-09c5d266b0b7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:23.309735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5193cf-c159-44a1-90f3-09c5d266b0b7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:23.315565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4cc0a-b992-4de7-bbf4-c309c9d7084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:23.316837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4cc0a-b992-4de7-bbf4-c309c9d7084c admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:23.317325 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4cc0a-b992-4de7-bbf4-c309c9d7084c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:23.317815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4cc0a-b992-4de7-bbf4-c309c9d7084c admin admin] PATH_INFO: `/v3/projects/df4c91d3ef8547ec8f439803e0635458/users/41041e59a6fb422badda5f58d7c615c3/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:23.320362 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4cc0a-b992-4de7-bbf4-c309c9d7084c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4c91d3ef8547ec8f439803e0635458, user_id=41041e59a6fb422badda5f58d7c615c3, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:23.323721 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4cc0a-b992-4de7-bbf4-c309c9d7084c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:23.353066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1167/2320] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:00:23 2021] PUT /identity/v3/projects/df4c91d3ef8547ec8f439803e0635458/users/41041e59a6fb422badda5f58d7c615c3/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:23.363775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ac4c-b750-464d-99f3-cdb247495a0a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:23.462103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:23.463409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:23.463912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:23.464405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] PATH_INFO: `/v3/users/36c3da1d048e4dffa8da21f21a1721b9` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:23.465989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c3da1d048e4dffa8da21f21a1721b9)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:23.469655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:23.555831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c3da1d048e4dffa8da21f21a1721b9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:23.569359 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c3da1d048e4dffa8da21f21a1721b9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:23.570661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c3da1d048e4dffa8da21f21a1721b9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:23.571269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c3da1d048e4dffa8da21f21a1721b9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:23.591250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c3da1d048e4dffa8da21f21a1721b9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:23.625700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1154/2321] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:00:23 2021] DELETE /identity/v3/users/36c3da1d048e4dffa8da21f21a1721b9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:23.632847 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d9b0-2d3d-43da-8d3d-cae54c7ae7e3 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:23.633517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d9b0-2d3d-43da-8d3d-cae54c7ae7e3 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:23.634089 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d9b0-2d3d-43da-8d3d-cae54c7ae7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:23.665538 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-ad67d9b0-2d3d-43da-8d3d-cae54c7ae7e3 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:23.668866 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ad67d9b0-2d3d-43da-8d3d-cae54c7ae7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:23.806312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1168/2322] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:23.874358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:23.877571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:24.002581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acd8b4-a1f3-453d-90f2-8e0b8d4eabe9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:24.013922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:24.014855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:24.015806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:24.016271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:24.032545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:24.034039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:24.051851 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1155/2323] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:00:26.058295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d9b0-2d3d-43da-8d3d-cae54c7ae7e3 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:26.060728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ad67d9b0-2d3d-43da-8d3d-cae54c7ae7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:26.099791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d9b0-2d3d-43da-8d3d-cae54c7ae7e3 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:26.122008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:26.123509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:26.124049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:26.124572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] PATH_INFO: `/v3/projects/c6d6beae1f6f41a8b9e25321bc4177ce` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:26.127870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d6beae1f6f41a8b9e25321bc4177ce)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:26.135646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:26.290317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d6beae1f6f41a8b9e25321bc4177ce', 'request_id': 'req-5e264913-e34b-4c6c-ac7c-da82d33578ff'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:26.311740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d6beae1f6f41a8b9e25321bc4177ce', 'request_id': 'req-5e264913-e34b-4c6c-ac7c-da82d33578ff'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:26.330243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d6beae1f6f41a8b9e25321bc4177ce', 'request_id': 'req-5e264913-e34b-4c6c-ac7c-da82d33578ff'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:26.372989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] The token cache is being invalidate because project c6d6beae1f6f41a8b9e25321bc4177ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:00:26.373327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:26.376060 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e264913-e34b-4c6c-ac7c-da82d33578ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:26.380671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1169/2324] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:00:26 2021] DELETE /identity/v3/projects/c6d6beae1f6f41a8b9e25321bc4177ce => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:26.793244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:26.795818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:26.854273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e427-efe7-424c-8759-f875c2a83790 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:27.260092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:27.261547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:27.262060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:27.262596 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] PATH_INFO: `/v3/users/8a05b043281f4541b6866e27c3ec1681` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:27.264887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a05b043281f4541b6866e27c3ec1681)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:27.268852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:27.420638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a05b043281f4541b6866e27c3ec1681'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:27.449784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a05b043281f4541b6866e27c3ec1681'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:27.450489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a05b043281f4541b6866e27c3ec1681'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:27.451191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a05b043281f4541b6866e27c3ec1681'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:27.466569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a05b043281f4541b6866e27c3ec1681'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:27.506215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1156/2325] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:00:26 2021] DELETE /identity/v3/users/8a05b043281f4541b6866e27c3ec1681 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:27.508679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5e661-b10f-4069-9167-e583330b19fd None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:27.509276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5e661-b10f-4069-9167-e583330b19fd None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:27.509400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5e661-b10f-4069-9167-e583330b19fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:27.559604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-4cb5e661-b10f-4069-9167-e583330b19fd None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:27.561213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4cb5e661-b10f-4069-9167-e583330b19fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:27.703028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1170/2326] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:27.743858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:27.745551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:27.909671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e26256-9715-4ba1-a390-e7b980511948 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:27.921889 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e8851-8264-4aef-9c67-c8b56805752a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:27.923027 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e8851-8264-4aef-9c67-c8b56805752a service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:27.923854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e8851-8264-4aef-9c67-c8b56805752a service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:27.924371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e8851-8264-4aef-9c67-c8b56805752a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:27.944895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e8851-8264-4aef-9c67-c8b56805752a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:27.946888 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e8851-8264-4aef-9c67-c8b56805752a service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:27.972150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1157/2327] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:00:31.527877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5e661-b10f-4069-9167-e583330b19fd None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:31.530234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4cb5e661-b10f-4069-9167-e583330b19fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:31.552999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5e661-b10f-4069-9167-e583330b19fd None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:31.581981 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:31.582819 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:31.583163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:31.583671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] PATH_INFO: `/v3/projects/6161e2ac42c24a0b979148c009204eb4` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:31.590710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6161e2ac42c24a0b979148c009204eb4)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:31.598820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:31.730278 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6161e2ac42c24a0b979148c009204eb4', 'request_id': 'req-638a9250-dbc0-4478-a9a1-274456cd8538'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:31.743070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6161e2ac42c24a0b979148c009204eb4', 'request_id': 'req-638a9250-dbc0-4478-a9a1-274456cd8538'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:31.766027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6161e2ac42c24a0b979148c009204eb4', 'request_id': 'req-638a9250-dbc0-4478-a9a1-274456cd8538'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:31.787724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] The token cache is being invalidate because project 6161e2ac42c24a0b979148c009204eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:00:31.788589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:31.789622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-638a9250-dbc0-4478-a9a1-274456cd8538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:00:31.796126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1171/2328] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:00:31 2021] DELETE /identity/v3/projects/6161e2ac42c24a0b979148c009204eb4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:31.798019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a8fd-47b5-44bc-8b48-a338aa42252e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:31.798563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a8fd-47b5-44bc-8b48-a338aa42252e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:31.798650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a8fd-47b5-44bc-8b48-a338aa42252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:31.840442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8bb1a8fd-47b5-44bc-8b48-a338aa42252e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:31.841578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8bb1a8fd-47b5-44bc-8b48-a338aa42252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:32.053355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1158/2329] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:00:32.062607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96535-aad7-435e-a736-f68476c4d343 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:32.062973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96535-aad7-435e-a736-f68476c4d343 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:32.063184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96535-aad7-435e-a736-f68476c4d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:32.134231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-76a96535-aad7-435e-a736-f68476c4d343 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:32.134231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-76a96535-aad7-435e-a736-f68476c4d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:32.166192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1a8fd-47b5-44bc-8b48-a338aa42252e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:32.175111 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1172/2330] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:32.179698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1a8fd-47b5-44bc-8b48-a338aa42252e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:32.186043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:32.186701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:32.187165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:32.187629 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:32.189700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:00:32.190298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:32.192228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:32.207219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1159/2331] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:00:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 15:00:32.212248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a96535-aad7-435e-a736-f68476c4d343 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:32.224072 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a96535-aad7-435e-a736-f68476c4d343 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:32.239417 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651f804-46cb-4b46-97af-83eb005c7ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:32.240694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f804-46cb-4b46-97af-83eb005c7ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:32.241260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f804-46cb-4b46-97af-83eb005c7ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:32.241917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f804-46cb-4b46-97af-83eb005c7ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:32.242821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651f804-46cb-4b46-97af-83eb005c7ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:32.245184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651f804-46cb-4b46-97af-83eb005c7ac2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:32.294874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1173/2332] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:00:32 2021] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:00:32.301787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:32.342098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed604a7a-7657-420a-87f3-9663bb004f2d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:32.560980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b716-9d29-401f-a9f6-667bf3abf116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:32.561602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b716-9d29-401f-a9f6-667bf3abf116 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:32.562141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b716-9d29-401f-a9f6-667bf3abf116 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:32.562513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b716-9d29-401f-a9f6-667bf3abf116 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:32.563148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74b716-9d29-401f-a9f6-667bf3abf116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:32.570780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74b716-9d29-401f-a9f6-667bf3abf116 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:32.628004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1160/2333] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:00:32 2021] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:00:32.630556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651f804-46cb-4b46-97af-83eb005c7ac2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:32.670692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651f804-46cb-4b46-97af-83eb005c7ac2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:32.682091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0553-b472-4d33-83f0-9c714a8bee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:32.682896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0553-b472-4d33-83f0-9c714a8bee59 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:32.683192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0553-b472-4d33-83f0-9c714a8bee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:32.683479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0553-b472-4d33-83f0-9c714a8bee59 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:32.684195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd0553-b472-4d33-83f0-9c714a8bee59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:32.685831 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd0553-b472-4d33-83f0-9c714a8bee59 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:32.702198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b716-9d29-401f-a9f6-667bf3abf116 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:32.702694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1174/2334] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:32 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:00:32.717056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b716-9d29-401f-a9f6-667bf3abf116 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:32.723240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd3908-c7d4-4b7e-8af0-8893b8e745aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:32.724278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3908-c7d4-4b7e-8af0-8893b8e745aa admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:32.724759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3908-c7d4-4b7e-8af0-8893b8e745aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:32.725196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3908-c7d4-4b7e-8af0-8893b8e745aa admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:32.726093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd3908-c7d4-4b7e-8af0-8893b8e745aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:32.727978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd3908-c7d4-4b7e-8af0-8893b8e745aa admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:32.741119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1161/2335] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:00:32 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:00:32.745791 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0553-b472-4d33-83f0-9c714a8bee59 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:32.761722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0553-b472-4d33-83f0-9c714a8bee59 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:32.786661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:32.789110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:32.790739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:32.791271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] PATH_INFO: `/v3/projects/f841e3461da3466b88a7b06605a476fa/users/e501030d5b904b0a812772a2e13a4d9d/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:32.867376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f841e3461da3466b88a7b06605a476fa, user_id=e501030d5b904b0a812772a2e13a4d9d, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:32.879961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:32.916877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1175/2336] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:00:32 2021] PUT /identity/v3/projects/f841e3461da3466b88a7b06605a476fa/users/e501030d5b904b0a812772a2e13a4d9d/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:00:32.927575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59f04-4581-44b1-96bd-87d8688b1f0c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:32.928683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59f04-4581-44b1-96bd-87d8688b1f0c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:32.928978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59f04-4581-44b1-96bd-87d8688b1f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:33.007394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-b8e59f04-4581-44b1-96bd-87d8688b1f0c None None] MFA Rules not processed for user `e501030d5b904b0a812772a2e13a4d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:33.008854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b8e59f04-4581-44b1-96bd-87d8688b1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:33.114222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1162/2337] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:32 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:33.117155 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:33.120226 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:33.265786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b3672-80c1-4052-af7b-2e97ef61d153 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:33.278356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0935143-5d1c-4b83-bc9a-e2bdc6808896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:33.278777 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935143-5d1c-4b83-bc9a-e2bdc6808896 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:33.279056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935143-5d1c-4b83-bc9a-e2bdc6808896 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:33.279873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935143-5d1c-4b83-bc9a-e2bdc6808896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:33.300360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0935143-5d1c-4b83-bc9a-e2bdc6808896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:33.304869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0935143-5d1c-4b83-bc9a-e2bdc6808896 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:33.324856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1176/2338] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:33 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:00:36.035307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d17444-e8d8-44a0-9c3d-7bc17916d97f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:36.036310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d17444-e8d8-44a0-9c3d-7bc17916d97f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:36.036837 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d17444-e8d8-44a0-9c3d-7bc17916d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:36.086906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-63d17444-e8d8-44a0-9c3d-7bc17916d97f None None] MFA Rules not processed for user `6446c590390540b19f1ba4a0c5320ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:36.088128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-63d17444-e8d8-44a0-9c3d-7bc17916d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:36.186031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1163/2339] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:36 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:36.448724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc54d-dabd-44d8-a43a-ae3fb17c54af None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:36.451015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc54d-dabd-44d8-a43a-ae3fb17c54af None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:36.452434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc54d-dabd-44d8-a43a-ae3fb17c54af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:36.536093 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-447cc54d-dabd-44d8-a43a-ae3fb17c54af None None] MFA Rules not processed for user `41041e59a6fb422badda5f58d7c615c3`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:36.537500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-447cc54d-dabd-44d8-a43a-ae3fb17c54af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:36.575009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d17444-e8d8-44a0-9c3d-7bc17916d97f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:36.576948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-63d17444-e8d8-44a0-9c3d-7bc17916d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:36.701962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1177/2340] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:36 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:36.721588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc54d-dabd-44d8-a43a-ae3fb17c54af None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:36.723954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-447cc54d-dabd-44d8-a43a-ae3fb17c54af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:36.857233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d17444-e8d8-44a0-9c3d-7bc17916d97f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:36.872139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab34fa9-adc9-457a-b039-09ca4dbf9435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:36.874924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab34fa9-adc9-457a-b039-09ca4dbf9435 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:36.875768 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab34fa9-adc9-457a-b039-09ca4dbf9435 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:36.876660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab34fa9-adc9-457a-b039-09ca4dbf9435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:36.880662 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-3ab34fa9-adc9-457a-b039-09ca4dbf9435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:36.990606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc54d-dabd-44d8-a43a-ae3fb17c54af None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:37.000066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92f456ee8cf4564aaca2b16f320b49d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:37.001587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:37.001989 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:37.002518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:37.006330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:37.046198 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab34fa9-adc9-457a-b039-09ca4dbf9435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:37.049650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab34fa9-adc9-457a-b039-09ca4dbf9435 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:37.084385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1164/2341] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:36 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:00:37.187585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:37.189227 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:37.212317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1178/2342] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:00:36 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:00:37.588575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce661-28f3-4d4f-9ab0-befa21755d01 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:37.589161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce661-28f3-4d4f-9ab0-befa21755d01 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:37.589658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce661-28f3-4d4f-9ab0-befa21755d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:37.778577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-3fbce661-28f3-4d4f-9ab0-befa21755d01 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:37.784039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-3fbce661-28f3-4d4f-9ab0-befa21755d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:37.957798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1165/2343] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 15:00:37 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:00:37.971130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:37.973120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:38.130001 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62e0bb-df51-48b1-884f-8137ef2fdd6a service glance] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:38.137057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d972e-e536-4e1d-86ce-a43423bc9192 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:38.137683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d972e-e536-4e1d-86ce-a43423bc9192 service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:38.137978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d972e-e536-4e1d-86ce-a43423bc9192 service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:38.138264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d972e-e536-4e1d-86ce-a43423bc9192 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:38.149351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d972e-e536-4e1d-86ce-a43423bc9192 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:38.151404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d972e-e536-4e1d-86ce-a43423bc9192 service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:38.164266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1179/2344] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:00:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:00:42.290214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a1ff-00f0-477a-bf05-554f02057fb8 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:42.291324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a1ff-00f0-477a-bf05-554f02057fb8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:42.291324 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a1ff-00f0-477a-bf05-554f02057fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:42.415876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0963a1ff-00f0-477a-bf05-554f02057fb8 None None] MFA Rules not processed for user `3aee7075283f455ebb1693f09ecd276e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:42.433997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0963a1ff-00f0-477a-bf05-554f02057fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:42.466023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1166/2345] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:42 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:55.911529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf34a8-21a6-4633-9b52-1a7332d0ff16 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:55.913066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf34a8-21a6-4633-9b52-1a7332d0ff16 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:55.913605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf34a8-21a6-4633-9b52-1a7332d0ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:55.954077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-12cf34a8-21a6-4633-9b52-1a7332d0ff16 None None] MFA Rules not processed for user `a1cbfc1dd41544d39c935a6a0dd4be2b`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:55.956053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-12cf34a8-21a6-4633-9b52-1a7332d0ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:55.967679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1180/2346] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:00:55 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:59.427465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754793-50cd-4c56-b614-bd5203929895 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:59.428449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754793-50cd-4c56-b614-bd5203929895 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:59.429044 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754793-50cd-4c56-b614-bd5203929895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:59.473845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-73754793-50cd-4c56-b614-bd5203929895 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:00:59.476487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-73754793-50cd-4c56-b614-bd5203929895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:00:59.492033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1167/2347] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 15:00:59 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:00:59.512794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf34a8-21a6-4633-9b52-1a7332d0ff16 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:00:59.528517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf34a8-21a6-4633-9b52-1a7332d0ff16 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:00:59.537280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567b7c-69c8-4ed6-a347-2dedf67a660e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:00:59.538231 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567b7c-69c8-4ed6-a347-2dedf67a660e service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:00:59.538991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567b7c-69c8-4ed6-a347-2dedf67a660e service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:00:59.539453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567b7c-69c8-4ed6-a347-2dedf67a660e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:00:59.556907 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567b7c-69c8-4ed6-a347-2dedf67a660e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:00:59.560476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567b7c-69c8-4ed6-a347-2dedf67a660e service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:00:59.592339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1181/2348] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:00:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:01:01.972497 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73754793-50cd-4c56-b614-bd5203929895 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:02.062272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73754793-50cd-4c56-b614-bd5203929895 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:02.067103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:02.067913 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:02.068205 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:02.068486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] PATH_INFO: `/v3/users/e501030d5b904b0a812772a2e13a4d9d` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:02.069627 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e501030d5b904b0a812772a2e13a4d9d)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:02.071591 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:02.149171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e501030d5b904b0a812772a2e13a4d9d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:02.162448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e501030d5b904b0a812772a2e13a4d9d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:02.163471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e501030d5b904b0a812772a2e13a4d9d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:02.164495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e501030d5b904b0a812772a2e13a4d9d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:02.183567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e501030d5b904b0a812772a2e13a4d9d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:02.210569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1168/2349] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:01:01 2021] DELETE /identity/v3/users/e501030d5b904b0a812772a2e13a4d9d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:02.212713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075abe75-ea18-443b-a374-114dfd263e71 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:02.213469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075abe75-ea18-443b-a374-114dfd263e71 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:02.213469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075abe75-ea18-443b-a374-114dfd263e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:02.247364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-075abe75-ea18-443b-a374-114dfd263e71 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:02.249315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-075abe75-ea18-443b-a374-114dfd263e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:02.326319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1182/2350] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:01:02.351020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:02.352516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:02.492719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54b5b0-33c7-4985-9005-763f048ef5cd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:02.519164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796e5ee-abe5-4598-b35f-00af10389023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:02.520171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e5ee-abe5-4598-b35f-00af10389023 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:02.520674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e5ee-abe5-4598-b35f-00af10389023 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:02.521349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e5ee-abe5-4598-b35f-00af10389023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:02.533011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796e5ee-abe5-4598-b35f-00af10389023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:02.534539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796e5ee-abe5-4598-b35f-00af10389023 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:02.545863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1169/2351] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:01:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:01:03.068468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075abe75-ea18-443b-a374-114dfd263e71 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:03.070391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-075abe75-ea18-443b-a374-114dfd263e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:03.087674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075abe75-ea18-443b-a374-114dfd263e71 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:03.094182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:03.095269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.095684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.096083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] PATH_INFO: `/v3/projects/f841e3461da3466b88a7b06605a476fa` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.098255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f841e3461da3466b88a7b06605a476fa)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:03.100439 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:03.160123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f841e3461da3466b88a7b06605a476fa', 'request_id': 'req-8cc9d537-1af4-4ec9-9138-e207e197dea2'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:03.165380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f841e3461da3466b88a7b06605a476fa', 'request_id': 'req-8cc9d537-1af4-4ec9-9138-e207e197dea2'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:03.178994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f841e3461da3466b88a7b06605a476fa', 'request_id': 'req-8cc9d537-1af4-4ec9-9138-e207e197dea2'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:03.200495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] The token cache is being invalidate because project f841e3461da3466b88a7b06605a476fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:01:03.200876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:03.201911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8cc9d537-1af4-4ec9-9138-e207e197dea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:03.204253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1183/2352] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:01:03 2021] DELETE /identity/v3/projects/f841e3461da3466b88a7b06605a476fa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:03.210914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2acc3b-7e9f-416c-b0c4-b6d0238d3a5c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.211747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2acc3b-7e9f-416c-b0c4-b6d0238d3a5c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.211747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2acc3b-7e9f-416c-b0c4-b6d0238d3a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.236333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-0b2acc3b-7e9f-416c-b0c4-b6d0238d3a5c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:03.239466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-0b2acc3b-7e9f-416c-b0c4-b6d0238d3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:03.317537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1170/2353] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:01:03.326633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b1ae-1edf-40be-93ae-992e8448cb45 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.327480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b1ae-1edf-40be-93ae-992e8448cb45 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.327480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b1ae-1edf-40be-93ae-992e8448cb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.359190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-6b19b1ae-1edf-40be-93ae-992e8448cb45 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:03.360692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6b19b1ae-1edf-40be-93ae-992e8448cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:03.368186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1184/2354] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:01:03.372608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2acc3b-7e9f-416c-b0c4-b6d0238d3a5c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:03.382917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2acc3b-7e9f-416c-b0c4-b6d0238d3a5c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:03.387975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:03.388590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.388880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.389195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.389908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:01:03.390213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:03.391914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:03.411004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1171/2355] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:01:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:01:03.413816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19b1ae-1edf-40be-93ae-992e8448cb45 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:03.428044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19b1ae-1edf-40be-93ae-992e8448cb45 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:03.435284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455948-4ae3-43e9-ab39-2e641ce1b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:03.436393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455948-4ae3-43e9-ab39-2e641ce1b2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.436855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455948-4ae3-43e9-ab39-2e641ce1b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.437267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455948-4ae3-43e9-ab39-2e641ce1b2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.437972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3455948-4ae3-43e9-ab39-2e641ce1b2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:03.440673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3455948-4ae3-43e9-ab39-2e641ce1b2e7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:03.470279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1185/2356] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:01:03 2021] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:01:03.477158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:03.493503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5840c2-7ab4-4a8b-8d22-eaee07992a4e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:03.580739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e2cfc-20cc-4c50-8dcd-3436815a6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:03.581683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e2cfc-20cc-4c50-8dcd-3436815a6f10 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.582281 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e2cfc-20cc-4c50-8dcd-3436815a6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.582753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e2cfc-20cc-4c50-8dcd-3436815a6f10 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.583516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e2cfc-20cc-4c50-8dcd-3436815a6f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:03.585579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e2cfc-20cc-4c50-8dcd-3436815a6f10 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:03.616089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1172/2357] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:01:03 2021] POST /identity/v3/users => generated 283 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:01:03.620816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455948-4ae3-43e9-ab39-2e641ce1b2e7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:03.633772 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455948-4ae3-43e9-ab39-2e641ce1b2e7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:03.639775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7fd7b-d88d-4f78-96a1-c4fccaf49c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:03.640574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7fd7b-d88d-4f78-96a1-c4fccaf49c13 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.641039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7fd7b-d88d-4f78-96a1-c4fccaf49c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.641561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7fd7b-d88d-4f78-96a1-c4fccaf49c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.642491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7fd7b-d88d-4f78-96a1-c4fccaf49c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:03.645052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7fd7b-d88d-4f78-96a1-c4fccaf49c13 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:03.664392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1186/2358] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:01:03 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:01:03.669645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e2cfc-20cc-4c50-8dcd-3436815a6f10 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:03.694582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e2cfc-20cc-4c50-8dcd-3436815a6f10 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:03.716183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72840-9286-4983-81b5-6dca9442f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:03.717256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72840-9286-4983-81b5-6dca9442f138 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.717805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72840-9286-4983-81b5-6dca9442f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.718251 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72840-9286-4983-81b5-6dca9442f138 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.719697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72840-9286-4983-81b5-6dca9442f138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:03.723410 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72840-9286-4983-81b5-6dca9442f138 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:03.737564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1173/2359] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:01:03 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:01:03.743067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7fd7b-d88d-4f78-96a1-c4fccaf49c13 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:03.763767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7fd7b-d88d-4f78-96a1-c4fccaf49c13 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:03.772202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:03.773858 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.774769 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.775458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] PATH_INFO: `/v3/projects/b55d8ea47bd94a2eb4263673841f7363/users/3422e887d73d48b5818230feaefba0b8/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.827529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55d8ea47bd94a2eb4263673841f7363, user_id=3422e887d73d48b5818230feaefba0b8, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:03.832002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:03.851571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1187/2360] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:01:03 2021] PUT /identity/v3/projects/b55d8ea47bd94a2eb4263673841f7363/users/3422e887d73d48b5818230feaefba0b8/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:03.864062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8205f-35c4-4e66-975b-9690c13a1088 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:03.864464 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8205f-35c4-4e66-975b-9690c13a1088 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:03.864820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8205f-35c4-4e66-975b-9690c13a1088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:03.947426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6ab8205f-35c4-4e66-975b-9690c13a1088 None None] MFA Rules not processed for user `3422e887d73d48b5818230feaefba0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:03.948024 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6ab8205f-35c4-4e66-975b-9690c13a1088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:04.066212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1174/2361] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:03 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:01:04.084448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:04.088534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:04.246380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c138e9-90e6-4f35-9a35-71ef8067fd62 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:04.254344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fe81-5da0-45bf-b990-607aeb3e0c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:04.256149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fe81-5da0-45bf-b990-607aeb3e0c26 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:04.256942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fe81-5da0-45bf-b990-607aeb3e0c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:04.257778 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fe81-5da0-45bf-b990-607aeb3e0c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:04.283177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777fe81-5da0-45bf-b990-607aeb3e0c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:04.290746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777fe81-5da0-45bf-b990-607aeb3e0c26 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:04.320071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1188/2362] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:01:04 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:01:43.023286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8205f-35c4-4e66-975b-9690c13a1088 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:43.027363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6ab8205f-35c4-4e66-975b-9690c13a1088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:43.181082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8205f-35c4-4e66-975b-9690c13a1088 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:43.185358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:43.185957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:43.186247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:43.186593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:43.188994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:43.316946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:43.320129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:43.337069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1175/2363] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:01:43 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:01:44.955654 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fe81-5da0-45bf-b990-607aeb3e0c26 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:44.966723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fe81-5da0-45bf-b990-607aeb3e0c26 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:44.970298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:44.970927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:44.972012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:44.972346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:44.974568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:45.065482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:45.067686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:45.082265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1189/2364] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:01:44 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:01:45.514272 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:45.516312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:45.633381 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87ca71-8b3e-487f-a623-0e5ceb2ac431 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:45.639103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:45.640113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:45.640411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:45.640696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] PATH_INFO: `/v3/users/f770ae4a0a644c12aa9bd1e7860faebf` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:45.642209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f770ae4a0a644c12aa9bd1e7860faebf)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:45.644537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:45.709020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f770ae4a0a644c12aa9bd1e7860faebf'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:45.725193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f770ae4a0a644c12aa9bd1e7860faebf'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:45.726189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f770ae4a0a644c12aa9bd1e7860faebf'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:45.727692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f770ae4a0a644c12aa9bd1e7860faebf'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:45.739702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cd5ea8da-afd0-4bc1-914c-13f34fd42989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f770ae4a0a644c12aa9bd1e7860faebf'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:45.764790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1176/2365] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:01:45 2021] DELETE /identity/v3/users/f770ae4a0a644c12aa9bd1e7860faebf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:46.571966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:46.587132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8570c1-c92e-4989-b8b3-9b55fb567ec6 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:46.678562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:46.679399 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:46.679680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:46.680140 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] PATH_INFO: `/v3/projects/bd3772dcd21e433081b8ba499e61cfb6` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:46.681343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3772dcd21e433081b8ba499e61cfb6)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:46.683533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:46.766102 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3772dcd21e433081b8ba499e61cfb6', 'request_id': 'req-37fe6c5b-1098-4e81-a4e1-041698326c2d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:46.773814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3772dcd21e433081b8ba499e61cfb6', 'request_id': 'req-37fe6c5b-1098-4e81-a4e1-041698326c2d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:46.782823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3772dcd21e433081b8ba499e61cfb6', 'request_id': 'req-37fe6c5b-1098-4e81-a4e1-041698326c2d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:46.801845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] The token cache is being invalidate because project bd3772dcd21e433081b8ba499e61cfb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:01:46.802387 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:46.803540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-37fe6c5b-1098-4e81-a4e1-041698326c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:46.805708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1190/2366] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:01:46 2021] DELETE /identity/v3/projects/bd3772dcd21e433081b8ba499e61cfb6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:46.814266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e39fb5-1c80-4f4f-8423-5c9ad58e627d None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:46.814970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e39fb5-1c80-4f4f-8423-5c9ad58e627d None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:46.814970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e39fb5-1c80-4f4f-8423-5c9ad58e627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:46.838799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e9e39fb5-1c80-4f4f-8423-5c9ad58e627d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:46.840233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e9e39fb5-1c80-4f4f-8423-5c9ad58e627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:46.919341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1177/2367] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:01:46.928444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00738-7ebc-4e3b-a5d8-aa297987d179 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:46.928795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00738-7ebc-4e3b-a5d8-aa297987d179 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:46.929154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00738-7ebc-4e3b-a5d8-aa297987d179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:46.954386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f4c00738-7ebc-4e3b-a5d8-aa297987d179 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:46.955702 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f4c00738-7ebc-4e3b-a5d8-aa297987d179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:46.964559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1191/2368] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:01:46.970257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e39fb5-1c80-4f4f-8423-5c9ad58e627d None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:46.980117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e39fb5-1c80-4f4f-8423-5c9ad58e627d None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:46.985532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:46.986128 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:46.986446 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:46.986723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:46.987432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:01:46.987725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:46.989415 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:47.004371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1178/2369] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:01:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 15:01:47.009382 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c00738-7ebc-4e3b-a5d8-aa297987d179 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:47.021329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c00738-7ebc-4e3b-a5d8-aa297987d179 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:47.030106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e669d3-87de-41e5-a636-d025c9c47537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:47.031542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e669d3-87de-41e5-a636-d025c9c47537 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:47.032728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e669d3-87de-41e5-a636-d025c9c47537 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:47.033357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e669d3-87de-41e5-a636-d025c9c47537 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:47.034803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e669d3-87de-41e5-a636-d025c9c47537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:47.038574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e669d3-87de-41e5-a636-d025c9c47537 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:47.086470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1192/2370] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:01:47 2021] POST /identity/v3/projects => generated 389 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:01:47.090919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:47.105658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2277717-95cd-4999-ad66-ea622ec3bc35 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:47.199970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a24a6-46ef-40e6-83f5-655a431c78cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:47.200731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a24a6-46ef-40e6-83f5-655a431c78cd admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:47.201089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a24a6-46ef-40e6-83f5-655a431c78cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:47.201410 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a24a6-46ef-40e6-83f5-655a431c78cd admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:47.202055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a24a6-46ef-40e6-83f5-655a431c78cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:47.204255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a24a6-46ef-40e6-83f5-655a431c78cd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:47.231092 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1179/2371] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:01:47 2021] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:01:47.236757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e669d3-87de-41e5-a636-d025c9c47537 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:47.248756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e669d3-87de-41e5-a636-d025c9c47537 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:47.255617 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be596ebf-6eee-420b-825f-27a7538db630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:47.256977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be596ebf-6eee-420b-825f-27a7538db630 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:47.257215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be596ebf-6eee-420b-825f-27a7538db630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:47.257521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be596ebf-6eee-420b-825f-27a7538db630 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:47.258208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be596ebf-6eee-420b-825f-27a7538db630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:47.260233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be596ebf-6eee-420b-825f-27a7538db630 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:47.280043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1193/2372] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:01:47 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:01:47.282458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a24a6-46ef-40e6-83f5-655a431c78cd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:47.296721 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a24a6-46ef-40e6-83f5-655a431c78cd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:47.320985 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b737a-25e0-4869-982a-583266d7b8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:47.321694 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b737a-25e0-4869-982a-583266d7b8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:47.322046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b737a-25e0-4869-982a-583266d7b8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:47.322421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b737a-25e0-4869-982a-583266d7b8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:47.323230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b737a-25e0-4869-982a-583266d7b8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:47.324917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b737a-25e0-4869-982a-583266d7b8b6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:47.369066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be596ebf-6eee-420b-825f-27a7538db630 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:47.374510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1180/2373] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:01:47 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:01:47.382892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be596ebf-6eee-420b-825f-27a7538db630 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:47.392342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:47.393742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:47.394251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:47.394789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] PATH_INFO: `/v3/projects/642447a5062244b2a248e9c27858419a/users/dee892a81cba413da63a4bbf1573fa94/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:47.429360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=642447a5062244b2a248e9c27858419a, user_id=dee892a81cba413da63a4bbf1573fa94, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:47.432897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:47.452757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1194/2374] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:01:47 2021] PUT /identity/v3/projects/642447a5062244b2a248e9c27858419a/users/dee892a81cba413da63a4bbf1573fa94/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:01:47.461697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c6a7-7b2b-49c7-83eb-f1e0733fda96 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:47.462187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c6a7-7b2b-49c7-83eb-f1e0733fda96 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:47.462736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c6a7-7b2b-49c7-83eb-f1e0733fda96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:47.507068 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a816c6a7-7b2b-49c7-83eb-f1e0733fda96 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:47.509003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a816c6a7-7b2b-49c7-83eb-f1e0733fda96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:47.673827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1181/2375] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:01:47.776187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:47.778077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:47.882553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b956b82-f745-4469-b555-f3812a0024bd admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:47.886821 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90b700-a157-4ae5-8bb5-2d58aae5f4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:47.887597 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b700-a157-4ae5-8bb5-2d58aae5f4db service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:47.888031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b700-a157-4ae5-8bb5-2d58aae5f4db service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:47.888458 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b700-a157-4ae5-8bb5-2d58aae5f4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:47.898838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90b700-a157-4ae5-8bb5-2d58aae5f4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:47.911843 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90b700-a157-4ae5-8bb5-2d58aae5f4db service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:47.936440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1195/2376] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:01:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:01:54.550178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c6a7-7b2b-49c7-83eb-f1e0733fda96 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:54.551771 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a816c6a7-7b2b-49c7-83eb-f1e0733fda96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:54.566033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c6a7-7b2b-49c7-83eb-f1e0733fda96 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:54.571453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:54.572583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:54.573029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:54.573449 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] PATH_INFO: `/v3/users/3422e887d73d48b5818230feaefba0b8` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:54.575028 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3422e887d73d48b5818230feaefba0b8)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:54.577960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:54.690036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3422e887d73d48b5818230feaefba0b8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:54.702006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3422e887d73d48b5818230feaefba0b8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:54.704369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3422e887d73d48b5818230feaefba0b8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:54.705471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3422e887d73d48b5818230feaefba0b8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:54.722497 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3422e887d73d48b5818230feaefba0b8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:54.746343 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1182/2377] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:01:54 2021] DELETE /identity/v3/users/3422e887d73d48b5818230feaefba0b8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:54.753060 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405bb0-9163-4915-bd31-ec710061faf6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:54.753666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405bb0-9163-4915-bd31-ec710061faf6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:54.753794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405bb0-9163-4915-bd31-ec710061faf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:54.801929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c4405bb0-9163-4915-bd31-ec710061faf6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:54.806996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c4405bb0-9163-4915-bd31-ec710061faf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:55.002974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1196/2378] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:01:55.015644 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:55.018458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:55.134460 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da1028-5dad-4171-9ab7-1a3eaa40efae admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:55.141292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:55.142785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:55.143177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:55.143562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:55.155450 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:55.158685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:55.173796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1183/2379] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:01:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:01:55.702532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4405bb0-9163-4915-bd31-ec710061faf6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:55.706593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c4405bb0-9163-4915-bd31-ec710061faf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:55.722872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4405bb0-9163-4915-bd31-ec710061faf6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:55.728061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:55.729148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:55.729601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:55.730023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] PATH_INFO: `/v3/users/9e0b49f365a542c080e2bdb043dc1387` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:55.731346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0b49f365a542c080e2bdb043dc1387)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:55.733991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:55.849871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0b49f365a542c080e2bdb043dc1387'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:55.878472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0b49f365a542c080e2bdb043dc1387'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:55.879625 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0b49f365a542c080e2bdb043dc1387'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:55.882116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0b49f365a542c080e2bdb043dc1387'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:55.903794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0b49f365a542c080e2bdb043dc1387'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:55.930095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1197/2380] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:01:55 2021] DELETE /identity/v3/users/9e0b49f365a542c080e2bdb043dc1387 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:56.368200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:56.372433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:56.397384 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a73b7-ef5b-4260-a0df-721868660a10 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:56.540962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:56.541924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:56.544525 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:56.545176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] PATH_INFO: `/v3/projects/b55d8ea47bd94a2eb4263673841f7363` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:56.549512 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55d8ea47bd94a2eb4263673841f7363)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:56.551632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:56.684287 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55d8ea47bd94a2eb4263673841f7363', 'request_id': 'req-4c7d7c43-97c6-4d82-ad48-2b04cc953259'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:56.708515 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55d8ea47bd94a2eb4263673841f7363', 'request_id': 'req-4c7d7c43-97c6-4d82-ad48-2b04cc953259'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:56.720710 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55d8ea47bd94a2eb4263673841f7363', 'request_id': 'req-4c7d7c43-97c6-4d82-ad48-2b04cc953259'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:56.742886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] The token cache is being invalidate because project b55d8ea47bd94a2eb4263673841f7363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:01:56.743271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:56.744196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4c7d7c43-97c6-4d82-ad48-2b04cc953259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:56.759901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1184/2381] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:01:56 2021] DELETE /identity/v3/projects/b55d8ea47bd94a2eb4263673841f7363 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:56.895668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:56.897991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:56.920438 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80185085-9f22-4318-adfd-bf8f3185d087 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:57.034006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:57.036686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.036686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.036686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] PATH_INFO: `/v3/projects/670374964f714196ab5d431e5e2fc9bd` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.039117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670374964f714196ab5d431e5e2fc9bd)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:57.044361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:57.151558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670374964f714196ab5d431e5e2fc9bd', 'request_id': 'req-8d75155b-f65f-428c-940c-6508a17ada19'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:57.161329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670374964f714196ab5d431e5e2fc9bd', 'request_id': 'req-8d75155b-f65f-428c-940c-6508a17ada19'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:57.176525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670374964f714196ab5d431e5e2fc9bd', 'request_id': 'req-8d75155b-f65f-428c-940c-6508a17ada19'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:57.202561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] The token cache is being invalidate because project 670374964f714196ab5d431e5e2fc9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:01:57.203330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:57.204392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-8d75155b-f65f-428c-940c-6508a17ada19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:01:57.206364 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1198/2382] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:01:56 2021] DELETE /identity/v3/projects/670374964f714196ab5d431e5e2fc9bd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:01:57.212137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198e1c9-1b26-4e4d-815b-2c5f5d8400e0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.212787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198e1c9-1b26-4e4d-815b-2c5f5d8400e0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.213257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198e1c9-1b26-4e4d-815b-2c5f5d8400e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.242577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8198e1c9-1b26-4e4d-815b-2c5f5d8400e0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:57.243865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8198e1c9-1b26-4e4d-815b-2c5f5d8400e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:57.331897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1185/2383] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:01:57.334860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7db06-1daa-4b97-a010-f0cee67c6fe5 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.335390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7db06-1daa-4b97-a010-f0cee67c6fe5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.336136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7db06-1daa-4b97-a010-f0cee67c6fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.377947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-46c7db06-1daa-4b97-a010-f0cee67c6fe5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:57.379397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-46c7db06-1daa-4b97-a010-f0cee67c6fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:57.389172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1199/2384] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:01:57.393315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198e1c9-1b26-4e4d-815b-2c5f5d8400e0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:57.403992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198e1c9-1b26-4e4d-815b-2c5f5d8400e0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:57.410761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:57.411379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.412431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.412773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.413434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:01:57.414295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:57.416496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:57.445939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1186/2385] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:01:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:01:57.450443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7db06-1daa-4b97-a010-f0cee67c6fe5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:57.462737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7db06-1daa-4b97-a010-f0cee67c6fe5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:57.468670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809a4a-ba4f-4116-9009-3f2777a612c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:57.469850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809a4a-ba4f-4116-9009-3f2777a612c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.470069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809a4a-ba4f-4116-9009-3f2777a612c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.470345 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809a4a-ba4f-4116-9009-3f2777a612c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.471024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19809a4a-ba4f-4116-9009-3f2777a612c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:57.472909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19809a4a-ba4f-4116-9009-3f2777a612c6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:57.510167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1200/2386] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:01:57 2021] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:01:57.511695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:57.523478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dff95-b5fb-4ed8-b9e6-3015b34a0d17 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:57.592222 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9339e4-0927-4754-901b-2e573500e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:57.592828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9339e4-0927-4754-901b-2e573500e0ad admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.593114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9339e4-0927-4754-901b-2e573500e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.593394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9339e4-0927-4754-901b-2e573500e0ad admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.594734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9339e4-0927-4754-901b-2e573500e0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:57.596630 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9339e4-0927-4754-901b-2e573500e0ad admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:57.620328 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1187/2387] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:01:57 2021] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:01:57.624138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809a4a-ba4f-4116-9009-3f2777a612c6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:57.637848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809a4a-ba4f-4116-9009-3f2777a612c6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:57.643179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938a9e4-3326-4bf2-bd77-b8f887fc117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:57.643811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a9e4-3326-4bf2-bd77-b8f887fc117a admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.644105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a9e4-3326-4bf2-bd77-b8f887fc117a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.644391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a9e4-3326-4bf2-bd77-b8f887fc117a admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.645112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938a9e4-3326-4bf2-bd77-b8f887fc117a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:57.647076 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938a9e4-3326-4bf2-bd77-b8f887fc117a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:57.663366 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1201/2388] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:01:57 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:01:57.664228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9339e4-0927-4754-901b-2e573500e0ad admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:57.677302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9339e4-0927-4754-901b-2e573500e0ad admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:57.682833 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa4166-a4fd-4c95-a33e-cf9ef2c2dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:57.684045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4166-a4fd-4c95-a33e-cf9ef2c2dc8e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.684530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4166-a4fd-4c95-a33e-cf9ef2c2dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.684966 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4166-a4fd-4c95-a33e-cf9ef2c2dc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.685872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa4166-a4fd-4c95-a33e-cf9ef2c2dc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:57.687736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa4166-a4fd-4c95-a33e-cf9ef2c2dc8e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:57.707922 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938a9e4-3326-4bf2-bd77-b8f887fc117a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:57.713621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1188/2389] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:01:57 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:01:57.723391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938a9e4-3326-4bf2-bd77-b8f887fc117a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:57.729339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:57.731459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.732241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.732685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] PATH_INFO: `/v3/projects/a20c07516f4e40f7854d58c1174e94f9/users/0faabcf478134cc68e2d2bf1f5bf13e4/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.767043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20c07516f4e40f7854d58c1174e94f9, user_id=0faabcf478134cc68e2d2bf1f5bf13e4, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:57.771171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:57.817506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1202/2390] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:01:57 2021] PUT /identity/v3/projects/a20c07516f4e40f7854d58c1174e94f9/users/0faabcf478134cc68e2d2bf1f5bf13e4/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:01:57.819204 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb223d4-faee-4822-9471-4c0a66e49f8f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:57.819758 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb223d4-faee-4822-9471-4c0a66e49f8f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:57.820199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb223d4-faee-4822-9471-4c0a66e49f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:57.867779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7eb223d4-faee-4822-9471-4c0a66e49f8f None None] MFA Rules not processed for user `0faabcf478134cc68e2d2bf1f5bf13e4`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:57.870016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7eb223d4-faee-4822-9471-4c0a66e49f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:57.973904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1189/2391] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:57 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:01:57.992900 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:57.995063 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:58.083726 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf332c-e2b0-4df2-a10f-ea0937c5b201 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:58.089582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:58.090201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:58.090749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:58.091033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:58.102387 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:58.104045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:58.114988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1203/2392] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:01:57 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:01:58.180382 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a291ef-754d-4eb4-b256-19d8c4bc2a2e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:58.180684 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a291ef-754d-4eb4-b256-19d8c4bc2a2e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:58.180965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a291ef-754d-4eb4-b256-19d8c4bc2a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:58.222332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-37a291ef-754d-4eb4-b256-19d8c4bc2a2e None None] MFA Rules not processed for user `dee892a81cba413da63a4bbf1573fa94`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:01:58.223603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-37a291ef-754d-4eb4-b256-19d8c4bc2a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:58.319256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1190/2393] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:01:58 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:01:58.340923 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:01:58.342347 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:01:58.361437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407452f-2f51-497d-8dfd-3ce5a55a6335 service nova] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:01:58.367651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d986fb2-6c5e-4213-a1e5-dbe55c98a55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:01:58.368262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986fb2-6c5e-4213-a1e5-dbe55c98a55b service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:01:58.368608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986fb2-6c5e-4213-a1e5-dbe55c98a55b service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:01:58.368915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986fb2-6c5e-4213-a1e5-dbe55c98a55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:01:58.383205 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d986fb2-6c5e-4213-a1e5-dbe55c98a55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:01:58.384913 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d986fb2-6c5e-4213-a1e5-dbe55c98a55b service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:01:58.396088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1204/2394] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:01:58 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:00.856816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40a0dd-71de-4a34-8b77-0291248052a4 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:00.857393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40a0dd-71de-4a34-8b77-0291248052a4 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:00.857537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40a0dd-71de-4a34-8b77-0291248052a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:00.887417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7f40a0dd-71de-4a34-8b77-0291248052a4 None None] MFA Rules not processed for user `dee892a81cba413da63a4bbf1573fa94`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:00.888592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7f40a0dd-71de-4a34-8b77-0291248052a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:00.895836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1191/2395] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:00 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:02:01.434266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d986fb2-6c5e-4213-a1e5-dbe55c98a55b service nova] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:01.520555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d986fb2-6c5e-4213-a1e5-dbe55c98a55b service nova] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:01.526095 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:01.530117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:01.531915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:01.532450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] PATH_INFO: `/v3/users/0faabcf478134cc68e2d2bf1f5bf13e4` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:01.534697 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0faabcf478134cc68e2d2bf1f5bf13e4)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:01.536987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:01.614312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0faabcf478134cc68e2d2bf1f5bf13e4'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:01.624181 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0faabcf478134cc68e2d2bf1f5bf13e4'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:01.625639 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0faabcf478134cc68e2d2bf1f5bf13e4'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:01.626313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0faabcf478134cc68e2d2bf1f5bf13e4'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:01.647636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0faabcf478134cc68e2d2bf1f5bf13e4'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:01.669826 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1205/2396] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:01 2021] DELETE /identity/v3/users/0faabcf478134cc68e2d2bf1f5bf13e4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:01.675147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd421ab-8b6d-4bd3-b293-eb53dce3bd12 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:01.675631 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd421ab-8b6d-4bd3-b293-eb53dce3bd12 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:01.676255 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd421ab-8b6d-4bd3-b293-eb53dce3bd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:01.704696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-5fd421ab-8b6d-4bd3-b293-eb53dce3bd12 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:01.705940 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5fd421ab-8b6d-4bd3-b293-eb53dce3bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:01.795923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1192/2397] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:02:01.801431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:01.803855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:01.933836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9402b5-270e-427b-9171-3973507f5743 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:01.938380 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075f81a-804b-4f17-8339-8dffa6a4b76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:01.939125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075f81a-804b-4f17-8339-8dffa6a4b76e service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:01.939478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075f81a-804b-4f17-8339-8dffa6a4b76e service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:01.939838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075f81a-804b-4f17-8339-8dffa6a4b76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:01.951255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075f81a-804b-4f17-8339-8dffa6a4b76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:01.953092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075f81a-804b-4f17-8339-8dffa6a4b76e service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:01.969454 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1206/2398] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:02.540537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd421ab-8b6d-4bd3-b293-eb53dce3bd12 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:02.542137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5fd421ab-8b6d-4bd3-b293-eb53dce3bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:02.556804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd421ab-8b6d-4bd3-b293-eb53dce3bd12 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:02.563040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:02.563702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:02.564087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:02.564407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] PATH_INFO: `/v3/projects/a20c07516f4e40f7854d58c1174e94f9` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:02.565677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20c07516f4e40f7854d58c1174e94f9)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:02.568034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:02.632901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20c07516f4e40f7854d58c1174e94f9', 'request_id': 'req-106d64a1-40b6-4973-82ee-c88dc8d74b1e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:02.638704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20c07516f4e40f7854d58c1174e94f9', 'request_id': 'req-106d64a1-40b6-4973-82ee-c88dc8d74b1e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:02.648575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20c07516f4e40f7854d58c1174e94f9', 'request_id': 'req-106d64a1-40b6-4973-82ee-c88dc8d74b1e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:02.676626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] The token cache is being invalidate because project a20c07516f4e40f7854d58c1174e94f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:02.676912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:02.677995 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-106d64a1-40b6-4973-82ee-c88dc8d74b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:02.679469 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1193/2399] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:02 2021] DELETE /identity/v3/projects/a20c07516f4e40f7854d58c1174e94f9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:02.689668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cf6cb-7c10-4e44-b9de-cc46677ee569 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:02.690754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cf6cb-7c10-4e44-b9de-cc46677ee569 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:02.691307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cf6cb-7c10-4e44-b9de-cc46677ee569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:02.721998 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7d8cf6cb-7c10-4e44-b9de-cc46677ee569 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:02.723192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7d8cf6cb-7c10-4e44-b9de-cc46677ee569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:02.811492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1207/2400] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:02.821270 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f1c8-5e5e-47f2-b6b9-b544f6f694d0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:02.821691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f1c8-5e5e-47f2-b6b9-b544f6f694d0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:02.822018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f1c8-5e5e-47f2-b6b9-b544f6f694d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:02.848276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4606f1c8-5e5e-47f2-b6b9-b544f6f694d0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:02.851810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4606f1c8-5e5e-47f2-b6b9-b544f6f694d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:02.875113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1194/2401] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:02.879590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cf6cb-7c10-4e44-b9de-cc46677ee569 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:02.890181 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cf6cb-7c10-4e44-b9de-cc46677ee569 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:02.903949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:02.905000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:02.905501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:02.906525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:02.907694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:02:02.908230 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:02.910085 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:02.926451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1208/2402] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:02:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:02:02.929776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f1c8-5e5e-47f2-b6b9-b544f6f694d0 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:02.939189 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f1c8-5e5e-47f2-b6b9-b544f6f694d0 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:02.944156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309e25-a01b-48b0-8f97-e7b3684703b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:02.944747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309e25-a01b-48b0-8f97-e7b3684703b6 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:02.945038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309e25-a01b-48b0-8f97-e7b3684703b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:02.945309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309e25-a01b-48b0-8f97-e7b3684703b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:02.945953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83309e25-a01b-48b0-8f97-e7b3684703b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:02.948082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83309e25-a01b-48b0-8f97-e7b3684703b6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:02.978055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1195/2403] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:02 2021] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:02.986285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:02.996977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0ef8-5a47-40a2-9570-9696d5ebb862 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:03.068407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d9a77-2f36-4389-ae4f-46f1e204d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:03.069018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9a77-2f36-4389-ae4f-46f1e204d619 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:03.069312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9a77-2f36-4389-ae4f-46f1e204d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:03.069591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9a77-2f36-4389-ae4f-46f1e204d619 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:03.070247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d9a77-2f36-4389-ae4f-46f1e204d619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:03.072301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d9a77-2f36-4389-ae4f-46f1e204d619 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:03.097877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1209/2404] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:02 2021] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:03.104859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309e25-a01b-48b0-8f97-e7b3684703b6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:03.122260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309e25-a01b-48b0-8f97-e7b3684703b6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:03.130666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7dda-cb6b-428f-a265-0d7ffbd919cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:03.132013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7dda-cb6b-428f-a265-0d7ffbd919cf admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:03.132193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7dda-cb6b-428f-a265-0d7ffbd919cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:03.132656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7dda-cb6b-428f-a265-0d7ffbd919cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:03.133909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7dda-cb6b-428f-a265-0d7ffbd919cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:03.137498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7dda-cb6b-428f-a265-0d7ffbd919cf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:03.154447 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1196/2405] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:03 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:03.159603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d9a77-2f36-4389-ae4f-46f1e204d619 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:03.171031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d9a77-2f36-4389-ae4f-46f1e204d619 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:03.175996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30762d0b-0d53-4d2b-b42b-10bf1581a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:03.176663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30762d0b-0d53-4d2b-b42b-10bf1581a15d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:03.176954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30762d0b-0d53-4d2b-b42b-10bf1581a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:03.177414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30762d0b-0d53-4d2b-b42b-10bf1581a15d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:03.178114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30762d0b-0d53-4d2b-b42b-10bf1581a15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:03.179808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30762d0b-0d53-4d2b-b42b-10bf1581a15d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:03.191392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1210/2406] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:03.197620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7dda-cb6b-428f-a265-0d7ffbd919cf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:03.214323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7dda-cb6b-428f-a265-0d7ffbd919cf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:03.223354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee057-980c-4895-abb3-902cb6290945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:03.225058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee057-980c-4895-abb3-902cb6290945 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:03.225260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee057-980c-4895-abb3-902cb6290945 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:03.225748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee057-980c-4895-abb3-902cb6290945 admin admin] PATH_INFO: `/v3/projects/cc5b615815a84977a264ad4b1bffb6d4/users/9253355d99e74284abeb5f8ca24f42d5/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:03.266030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afee057-980c-4895-abb3-902cb6290945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5b615815a84977a264ad4b1bffb6d4, user_id=9253355d99e74284abeb5f8ca24f42d5, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:03.268800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afee057-980c-4895-abb3-902cb6290945 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:03.286517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1197/2407] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:03 2021] PUT /identity/v3/projects/cc5b615815a84977a264ad4b1bffb6d4/users/9253355d99e74284abeb5f8ca24f42d5/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:03.296763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6932a-d5d9-4fac-9e10-913db663568e None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:03.297183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6932a-d5d9-4fac-9e10-913db663568e None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:03.297387 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6932a-d5d9-4fac-9e10-913db663568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:03.342734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-95f6932a-d5d9-4fac-9e10-913db663568e None None] MFA Rules not processed for user `9253355d99e74284abeb5f8ca24f42d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:03.344606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-95f6932a-d5d9-4fac-9e10-913db663568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:03.478078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1211/2408] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:03 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:03.482645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee057-980c-4895-abb3-902cb6290945 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:03.610484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee057-980c-4895-abb3-902cb6290945 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:03.622293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c0b0b-0b95-4c55-915f-6e699999d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:03.623363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0b0b-0b95-4c55-915f-6e699999d2fa admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:03.629611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0b0b-0b95-4c55-915f-6e699999d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:03.630067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0b0b-0b95-4c55-915f-6e699999d2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:03.630870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0b0b-0b95-4c55-915f-6e699999d2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:03.632895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0b0b-0b95-4c55-915f-6e699999d2fa admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:03.671892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1198/2409] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:03 2021] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:03.677544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6932a-d5d9-4fac-9e10-913db663568e None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:03.698336 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6932a-d5d9-4fac-9e10-913db663568e None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:03.892152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bee54b-7cba-4589-acb0-4949d46c5d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:03.893189 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee54b-7cba-4589-acb0-4949d46c5d45 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:03.893701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee54b-7cba-4589-acb0-4949d46c5d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:03.894217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee54b-7cba-4589-acb0-4949d46c5d45 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:03.895122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bee54b-7cba-4589-acb0-4949d46c5d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:03.897338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bee54b-7cba-4589-acb0-4949d46c5d45 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:03.925350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1212/2410] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:03 2021] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:03.929814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c0b0b-0b95-4c55-915f-6e699999d2fa admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:03.945864 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c0b0b-0b95-4c55-915f-6e699999d2fa admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:03.957400 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2821-50f0-4d0f-9045-729d9df04ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:03.958521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2821-50f0-4d0f-9045-729d9df04ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:03.959478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2821-50f0-4d0f-9045-729d9df04ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:03.959759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2821-50f0-4d0f-9045-729d9df04ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:03.960726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a2821-50f0-4d0f-9045-729d9df04ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:03.962775 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a2821-50f0-4d0f-9045-729d9df04ea5 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:03.985094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bee54b-7cba-4589-acb0-4949d46c5d45 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:03.996282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1199/2411] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:03 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:04.016472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bee54b-7cba-4589-acb0-4949d46c5d45 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:04.028571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19b39-80af-4811-91e1-7c0732c870c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:04.032736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19b39-80af-4811-91e1-7c0732c870c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:04.033836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19b39-80af-4811-91e1-7c0732c870c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:04.034599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19b39-80af-4811-91e1-7c0732c870c8 admin admin] PATH_INFO: `/v3/projects/a9e561fcd10f40ad82f9cca2ba772cd3/users/38f113968f8944a68540ce22cb8b2760/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:04.063282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19b39-80af-4811-91e1-7c0732c870c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e561fcd10f40ad82f9cca2ba772cd3, user_id=38f113968f8944a68540ce22cb8b2760, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:04.071373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19b39-80af-4811-91e1-7c0732c870c8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:04.093841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1213/2412] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:03 2021] PUT /identity/v3/projects/a9e561fcd10f40ad82f9cca2ba772cd3/users/38f113968f8944a68540ce22cb8b2760/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:04.099626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2821-50f0-4d0f-9045-729d9df04ea5 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:04.127886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2821-50f0-4d0f-9045-729d9df04ea5 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:04.253962 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8ef9d-b05d-4c45-b4b1-fb946e8572c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:04.255011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ef9d-b05d-4c45-b4b1-fb946e8572c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:04.255535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ef9d-b05d-4c45-b4b1-fb946e8572c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:04.256029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ef9d-b05d-4c45-b4b1-fb946e8572c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:04.256950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8ef9d-b05d-4c45-b4b1-fb946e8572c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:04.259533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8ef9d-b05d-4c45-b4b1-fb946e8572c2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:04.273867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1200/2413] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:04.278505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19b39-80af-4811-91e1-7c0732c870c8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:04.292136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19b39-80af-4811-91e1-7c0732c870c8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:04.297580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:04.298689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:04.299090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:04.299451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] PATH_INFO: `/v3/projects/a9e561fcd10f40ad82f9cca2ba772cd3/users/38f113968f8944a68540ce22cb8b2760/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:04.301464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e561fcd10f40ad82f9cca2ba772cd3, user_id=38f113968f8944a68540ce22cb8b2760, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:04.304357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:04.316473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1214/2414] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:04 2021] PUT /identity/v3/projects/a9e561fcd10f40ad82f9cca2ba772cd3/users/38f113968f8944a68540ce22cb8b2760/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:04.326458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17300-634e-4d3b-9ade-0cb587a2eda4 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:04.326735 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17300-634e-4d3b-9ade-0cb587a2eda4 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:04.326999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17300-634e-4d3b-9ade-0cb587a2eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:04.368042 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-18b17300-634e-4d3b-9ade-0cb587a2eda4 None None] MFA Rules not processed for user `38f113968f8944a68540ce22cb8b2760`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:04.369322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-18b17300-634e-4d3b-9ade-0cb587a2eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:04.450702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1201/2415] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:04 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:04.460771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:04.462453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:04.540491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c681e-0f34-484a-8c72-911fa39882cb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:04.544543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6a4b1-4ebe-474f-a205-3c4896c8a130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:04.545142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a4b1-4ebe-474f-a205-3c4896c8a130 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:04.545431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a4b1-4ebe-474f-a205-3c4896c8a130 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:04.545715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a4b1-4ebe-474f-a205-3c4896c8a130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:04.556085 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6a4b1-4ebe-474f-a205-3c4896c8a130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:04.557527 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6a4b1-4ebe-474f-a205-3c4896c8a130 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:04.567330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1215/2416] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:04 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:04.595392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b17300-634e-4d3b-9ade-0cb587a2eda4 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:04.672439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b17300-634e-4d3b-9ade-0cb587a2eda4 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:04.677227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:04.678048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:04.678339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:04.678657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] PATH_INFO: `/v3/users/9253355d99e74284abeb5f8ca24f42d5` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:04.679875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9253355d99e74284abeb5f8ca24f42d5)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:04.681792 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:04.758902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9253355d99e74284abeb5f8ca24f42d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:04.771611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9253355d99e74284abeb5f8ca24f42d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:04.772502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9253355d99e74284abeb5f8ca24f42d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:04.773237 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9253355d99e74284abeb5f8ca24f42d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:04.784906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9253355d99e74284abeb5f8ca24f42d5'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:04.817195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1202/2417] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:04 2021] DELETE /identity/v3/users/9253355d99e74284abeb5f8ca24f42d5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:04.820970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7a73-a0de-4b76-8b95-321e376b949d None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:04.821972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7a73-a0de-4b76-8b95-321e376b949d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:04.822371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7a73-a0de-4b76-8b95-321e376b949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:04.849386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-233a7a73-a0de-4b76-8b95-321e376b949d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:04.851624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-233a7a73-a0de-4b76-8b95-321e376b949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:04.940790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1216/2418] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:04.955034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:04.956730 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:05.036480 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb3876-7a4f-48bb-b3a1-5a0e82db2d99 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:05.040216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59181e2-ddc2-4b22-8933-643fa7a9c09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:05.040882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59181e2-ddc2-4b22-8933-643fa7a9c09c service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:05.041160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59181e2-ddc2-4b22-8933-643fa7a9c09c service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:05.041437 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59181e2-ddc2-4b22-8933-643fa7a9c09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:05.052205 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59181e2-ddc2-4b22-8933-643fa7a9c09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:05.053917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59181e2-ddc2-4b22-8933-643fa7a9c09c service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:05.065164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1203/2419] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:02:05.974213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a7a73-a0de-4b76-8b95-321e376b949d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:05.977691 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-233a7a73-a0de-4b76-8b95-321e376b949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:05.995338 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a7a73-a0de-4b76-8b95-321e376b949d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:06.002003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:06.002978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:06.003266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:06.003626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] PATH_INFO: `/v3/projects/cc5b615815a84977a264ad4b1bffb6d4` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:06.004800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5b615815a84977a264ad4b1bffb6d4)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:06.006911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:06.067631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5b615815a84977a264ad4b1bffb6d4', 'request_id': 'req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.074192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5b615815a84977a264ad4b1bffb6d4', 'request_id': 'req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.083482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5b615815a84977a264ad4b1bffb6d4', 'request_id': 'req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.106183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] The token cache is being invalidate because project cc5b615815a84977a264ad4b1bffb6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:06.106966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.107870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.109997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1217/2420] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:05 2021] DELETE /identity/v3/projects/cc5b615815a84977a264ad4b1bffb6d4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:06.113974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59181e2-ddc2-4b22-8933-643fa7a9c09c service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:06.123897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59181e2-ddc2-4b22-8933-643fa7a9c09c service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:06.212463 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:06.213279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:06.213573 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:06.213916 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] PATH_INFO: `/v3/users/38f113968f8944a68540ce22cb8b2760` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:06.215059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f113968f8944a68540ce22cb8b2760)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:06.217022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:06.278810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f113968f8944a68540ce22cb8b2760'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.288242 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f113968f8944a68540ce22cb8b2760'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.289231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f113968f8944a68540ce22cb8b2760'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.290234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f113968f8944a68540ce22cb8b2760'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.301019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-150c7a0d-6402-40cf-84b1-9b356ef58551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f113968f8944a68540ce22cb8b2760'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:06.321052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1204/2421] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:06 2021] DELETE /identity/v3/users/38f113968f8944a68540ce22cb8b2760 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:07.041282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:07.042823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:07.081233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7e918-34ed-4d1b-83ef-4a55ead67e47 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:07.172864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:07.173702 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.173991 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.174276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] PATH_INFO: `/v3/projects/a9e561fcd10f40ad82f9cca2ba772cd3` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.175543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e561fcd10f40ad82f9cca2ba772cd3)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:07.180696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:07.239311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e561fcd10f40ad82f9cca2ba772cd3', 'request_id': 'req-aa20bb3c-9da0-40de-be69-8584a489abf3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:07.245945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e561fcd10f40ad82f9cca2ba772cd3', 'request_id': 'req-aa20bb3c-9da0-40de-be69-8584a489abf3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:07.256750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e561fcd10f40ad82f9cca2ba772cd3', 'request_id': 'req-aa20bb3c-9da0-40de-be69-8584a489abf3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:07.282870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] The token cache is being invalidate because project a9e561fcd10f40ad82f9cca2ba772cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:07.284062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:07.284781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa20bb3c-9da0-40de-be69-8584a489abf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:07.286258 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1218/2422] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:07 2021] DELETE /identity/v3/projects/a9e561fcd10f40ad82f9cca2ba772cd3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:07.292957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782f1c2-8fc4-46be-ad15-e92574e8505b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.293534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782f1c2-8fc4-46be-ad15-e92574e8505b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.293634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782f1c2-8fc4-46be-ad15-e92574e8505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.318956 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-3782f1c2-8fc4-46be-ad15-e92574e8505b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:07.320239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-3782f1c2-8fc4-46be-ad15-e92574e8505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:07.392060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1205/2423] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:02:07.401234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeda452-7a51-4b6c-b72d-d7749e9cc28f None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.401526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeda452-7a51-4b6c-b72d-d7749e9cc28f None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.401806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeda452-7a51-4b6c-b72d-d7749e9cc28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.426828 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-9aeda452-7a51-4b6c-b72d-d7749e9cc28f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:07.428038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9aeda452-7a51-4b6c-b72d-d7749e9cc28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:07.436607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1219/2424] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:07.441805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782f1c2-8fc4-46be-ad15-e92574e8505b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:07.452458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782f1c2-8fc4-46be-ad15-e92574e8505b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:07.457577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:07.458185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.458513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.458804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.459553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:02:07.459865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:07.461464 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:07.477923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1206/2425] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:02:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 15:02:07.484553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeda452-7a51-4b6c-b72d-d7749e9cc28f None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:07.499141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeda452-7a51-4b6c-b72d-d7749e9cc28f None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:07.506059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da591d6-9d05-45d2-898d-93abd92ab82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:07.506706 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da591d6-9d05-45d2-898d-93abd92ab82e admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.507008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da591d6-9d05-45d2-898d-93abd92ab82e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.507292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da591d6-9d05-45d2-898d-93abd92ab82e admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.507953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da591d6-9d05-45d2-898d-93abd92ab82e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:07.509886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da591d6-9d05-45d2-898d-93abd92ab82e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:07.540414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1220/2426] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:07 2021] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:02:07.545318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:07.556352 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754dcf-57c3-4950-a961-0a3ff8532345 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:07.629412 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12a56f-1d01-4517-8095-b4647cf385ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:07.630014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a56f-1d01-4517-8095-b4647cf385ab admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.630299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a56f-1d01-4517-8095-b4647cf385ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.630603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a56f-1d01-4517-8095-b4647cf385ab admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.631241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12a56f-1d01-4517-8095-b4647cf385ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:07.633188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12a56f-1d01-4517-8095-b4647cf385ab admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:07.653319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1207/2427] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:07 2021] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:07.657709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da591d6-9d05-45d2-898d-93abd92ab82e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:07.667517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da591d6-9d05-45d2-898d-93abd92ab82e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:07.672509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a592305-a651-4e43-be26-0a83924cbfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:07.673106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a592305-a651-4e43-be26-0a83924cbfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.673391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a592305-a651-4e43-be26-0a83924cbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.673672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a592305-a651-4e43-be26-0a83924cbfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.674359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a592305-a651-4e43-be26-0a83924cbfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:07.675994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a592305-a651-4e43-be26-0a83924cbfb7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:07.686463 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1221/2428] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:07.691184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12a56f-1d01-4517-8095-b4647cf385ab admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:07.701108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12a56f-1d01-4517-8095-b4647cf385ab admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:07.705695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b40be3-9a62-41ff-afe6-9e972a023b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:07.706206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40be3-9a62-41ff-afe6-9e972a023b58 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.706523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40be3-9a62-41ff-afe6-9e972a023b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.706803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40be3-9a62-41ff-afe6-9e972a023b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.707495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40be3-9a62-41ff-afe6-9e972a023b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:07.709233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40be3-9a62-41ff-afe6-9e972a023b58 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:07.719916 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1208/2429] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:07.724310 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a592305-a651-4e43-be26-0a83924cbfb7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:07.740715 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a592305-a651-4e43-be26-0a83924cbfb7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:07.748297 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17780-eb52-4e66-b682-ba955b9e3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:07.750377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17780-eb52-4e66-b682-ba955b9e3e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.750963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17780-eb52-4e66-b682-ba955b9e3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.751471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17780-eb52-4e66-b682-ba955b9e3e64 admin admin] PATH_INFO: `/v3/projects/7ab2ce0456734d86a348b91b01c6faaa/users/91739203b2e64fb4a196ce1224f94b87/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.794534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17780-eb52-4e66-b682-ba955b9e3e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab2ce0456734d86a348b91b01c6faaa, user_id=91739203b2e64fb4a196ce1224f94b87, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:07.798372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17780-eb52-4e66-b682-ba955b9e3e64 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:07.819494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1222/2430] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:07 2021] PUT /identity/v3/projects/7ab2ce0456734d86a348b91b01c6faaa/users/91739203b2e64fb4a196ce1224f94b87/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:07.829809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0b16-01db-42d7-bf35-ef1d25244007 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:07.830100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0b16-01db-42d7-bf35-ef1d25244007 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:07.830998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0b16-01db-42d7-bf35-ef1d25244007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:07.870121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-121a0b16-01db-42d7-bf35-ef1d25244007 None None] MFA Rules not processed for user `91739203b2e64fb4a196ce1224f94b87`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:07.871348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-121a0b16-01db-42d7-bf35-ef1d25244007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:07.953569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1209/2431] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:07 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:07.957842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17780-eb52-4e66-b682-ba955b9e3e64 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:08.044253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17780-eb52-4e66-b682-ba955b9e3e64 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:08.052533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dad5b3-7bdd-495a-b718-2a7538f6f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:08.053168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad5b3-7bdd-495a-b718-2a7538f6f4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:08.053445 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad5b3-7bdd-495a-b718-2a7538f6f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:08.053723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad5b3-7bdd-495a-b718-2a7538f6f4f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:08.054389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dad5b3-7bdd-495a-b718-2a7538f6f4f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:08.056377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dad5b3-7bdd-495a-b718-2a7538f6f4f2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:08.096459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1223/2432] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:07 2021] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:08.100863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a0b16-01db-42d7-bf35-ef1d25244007 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:08.114578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a0b16-01db-42d7-bf35-ef1d25244007 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:08.190845 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338dd73-ca6a-4078-b323-20bf525e5758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:08.191529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338dd73-ca6a-4078-b323-20bf525e5758 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:08.191822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338dd73-ca6a-4078-b323-20bf525e5758 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:08.192104 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338dd73-ca6a-4078-b323-20bf525e5758 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:08.192750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338dd73-ca6a-4078-b323-20bf525e5758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:08.194735 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338dd73-ca6a-4078-b323-20bf525e5758 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:08.225293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1210/2433] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:08 2021] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:02:08.230178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dad5b3-7bdd-495a-b718-2a7538f6f4f2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:08.241497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dad5b3-7bdd-495a-b718-2a7538f6f4f2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:08.246926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7cd97-1b0c-494e-bf57-6a2de70511bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:08.247764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7cd97-1b0c-494e-bf57-6a2de70511bb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:08.248055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7cd97-1b0c-494e-bf57-6a2de70511bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:08.248339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7cd97-1b0c-494e-bf57-6a2de70511bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:08.249055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7cd97-1b0c-494e-bf57-6a2de70511bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:08.250787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7cd97-1b0c-494e-bf57-6a2de70511bb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:08.265024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1224/2434] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:08.269877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338dd73-ca6a-4078-b323-20bf525e5758 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:08.279944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338dd73-ca6a-4078-b323-20bf525e5758 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:08.285032 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed848e-7e7b-4482-b0c0-d3fa81863ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:08.285861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed848e-7e7b-4482-b0c0-d3fa81863ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:08.286227 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed848e-7e7b-4482-b0c0-d3fa81863ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:08.286458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed848e-7e7b-4482-b0c0-d3fa81863ff1 admin admin] PATH_INFO: `/v3/projects/7fcd9535ab394445a7ccb380652b981b/users/fae02ca47ce74932b5c4358c8d4ccea6/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:08.307322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed848e-7e7b-4482-b0c0-d3fa81863ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcd9535ab394445a7ccb380652b981b, user_id=fae02ca47ce74932b5c4358c8d4ccea6, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:08.310484 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed848e-7e7b-4482-b0c0-d3fa81863ff1 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:08.325263 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1211/2435] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:08 2021] PUT /identity/v3/projects/7fcd9535ab394445a7ccb380652b981b/users/fae02ca47ce74932b5c4358c8d4ccea6/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:08.330184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7cd97-1b0c-494e-bf57-6a2de70511bb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:08.340339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7cd97-1b0c-494e-bf57-6a2de70511bb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:08.410203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209e201-4493-4354-9380-74552fc56948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:08.410914 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209e201-4493-4354-9380-74552fc56948 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:08.411210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209e201-4493-4354-9380-74552fc56948 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:08.411496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209e201-4493-4354-9380-74552fc56948 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:08.412201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209e201-4493-4354-9380-74552fc56948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:08.413809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209e201-4493-4354-9380-74552fc56948 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:08.431152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1225/2436] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:02:08.432711 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed848e-7e7b-4482-b0c0-d3fa81863ff1 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:08.443852 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed848e-7e7b-4482-b0c0-d3fa81863ff1 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:08.448603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:08.449495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:08.449786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:08.450072 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] PATH_INFO: `/v3/projects/7fcd9535ab394445a7ccb380652b981b/users/fae02ca47ce74932b5c4358c8d4ccea6/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:08.452039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcd9535ab394445a7ccb380652b981b, user_id=fae02ca47ce74932b5c4358c8d4ccea6, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:08.455377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:08.472624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1212/2437] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:08 2021] PUT /identity/v3/projects/7fcd9535ab394445a7ccb380652b981b/users/fae02ca47ce74932b5c4358c8d4ccea6/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:08.492126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c6ba-261f-4b4f-860c-6ffc23ae7fd4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:08.492592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c6ba-261f-4b4f-860c-6ffc23ae7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:08.493019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c6ba-261f-4b4f-860c-6ffc23ae7fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:08.556630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0063c6ba-261f-4b4f-860c-6ffc23ae7fd4 None None] MFA Rules not processed for user `fae02ca47ce74932b5c4358c8d4ccea6`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:08.557811 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0063c6ba-261f-4b4f-860c-6ffc23ae7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:08.658732 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1226/2438] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:08 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:02:08.677513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:08.680160 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:08.764091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505504-4d3b-4bd6-9852-646d0475d699 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:08.769015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623204f-9784-4f5c-b76e-7c0dfd942d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:08.769705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623204f-9784-4f5c-b76e-7c0dfd942d81 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:08.770053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623204f-9784-4f5c-b76e-7c0dfd942d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:08.770417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623204f-9784-4f5c-b76e-7c0dfd942d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:08.782518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623204f-9784-4f5c-b76e-7c0dfd942d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:08.783508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623204f-9784-4f5c-b76e-7c0dfd942d81 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:08.795207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1213/2439] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:08 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:09.240754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063c6ba-261f-4b4f-860c-6ffc23ae7fd4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:09.250457 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063c6ba-261f-4b4f-860c-6ffc23ae7fd4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:09.255136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae02ca47ce74932b5c4358c8d4ccea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fcd9535ab394445a7ccb380652b981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:09.255742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:09.256028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:09.256414 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:09.257014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:02:09.257322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:09.258971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:09.274710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1227/2440] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:02:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:02:09.279380 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623204f-9784-4f5c-b76e-7c0dfd942d81 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:09.293761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623204f-9784-4f5c-b76e-7c0dfd942d81 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:09.302008 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90982755-8b8a-48d2-96d5-3aa503010494 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae02ca47ce74932b5c4358c8d4ccea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fcd9535ab394445a7ccb380652b981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:09.303091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90982755-8b8a-48d2-96d5-3aa503010494 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:09.303618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90982755-8b8a-48d2-96d5-3aa503010494 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:09.304144 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90982755-8b8a-48d2-96d5-3aa503010494 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:09.305410 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90982755-8b8a-48d2-96d5-3aa503010494 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:09.309178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90982755-8b8a-48d2-96d5-3aa503010494 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:09.350429 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1214/2441] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:09 2021] POST /identity/v3/projects => generated 354 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:09.354688 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:09.365073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab2718-c8b7-4fb3-b5d7-d9189384e0bd tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:09.431757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae02ca47ce74932b5c4358c8d4ccea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fcd9535ab394445a7ccb380652b981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:09.432389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:09.432686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:09.432974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:09.433673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:02:09.433979 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:09.435666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:09.447970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1228/2442] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:02:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:02:09.485456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90982755-8b8a-48d2-96d5-3aa503010494 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:09.495468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90982755-8b8a-48d2-96d5-3aa503010494 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:09.499965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae02ca47ce74932b5c4358c8d4ccea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fcd9535ab394445a7ccb380652b981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:09.500764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:09.501059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:09.501345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] PATH_INFO: `/v3/projects/bd1ce30fb2814748926675729ab6c76d` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:09.502520 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd1ce30fb2814748926675729ab6c76d)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:09.504672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:09.557617 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1ce30fb2814748926675729ab6c76d', 'request_id': 'req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:09.562774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1ce30fb2814748926675729ab6c76d', 'request_id': 'req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:09.570661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1ce30fb2814748926675729ab6c76d', 'request_id': 'req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:09.587260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] The token cache is being invalidate because project bd1ce30fb2814748926675729ab6c76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:09.587260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:09.588012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6990cc98-bac7-4430-9ce2-c7b8a231cd5c tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:09.589499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1215/2443] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:09 2021] DELETE /identity/v3/projects/bd1ce30fb2814748926675729ab6c76d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:09.847365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:09.849125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:09.931647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40c47d-ef36-4bcf-9e6d-049060d16bd3 tempest-VolumeQuotaClassesTest-286825049 tempest-VolumeQuotaClassesTest-286825049-project-admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:10.000053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:10.000954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:10.001246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:10.001530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] PATH_INFO: `/v3/users/91739203b2e64fb4a196ce1224f94b87` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:10.002908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91739203b2e64fb4a196ce1224f94b87)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:10.004760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:10.056615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91739203b2e64fb4a196ce1224f94b87'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.064682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91739203b2e64fb4a196ce1224f94b87'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.066767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91739203b2e64fb4a196ce1224f94b87'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.067419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91739203b2e64fb4a196ce1224f94b87'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.081879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91739203b2e64fb4a196ce1224f94b87'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.096194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1229/2444] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:09 2021] DELETE /identity/v3/users/91739203b2e64fb4a196ce1224f94b87 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:10.101631 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa74af6-0007-4b90-bacc-0021c05b7e26 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:10.102002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa74af6-0007-4b90-bacc-0021c05b7e26 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:10.102362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa74af6-0007-4b90-bacc-0021c05b7e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:10.126530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-9fa74af6-0007-4b90-bacc-0021c05b7e26 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:10.127709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9fa74af6-0007-4b90-bacc-0021c05b7e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:10.200303 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1216/2445] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:10.212012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:10.213345 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:10.280319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b457262-d657-4583-9edb-b9b642196460 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:10.283910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf845-8ba2-4e49-ba27-826e7537bb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:10.284500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf845-8ba2-4e49-ba27-826e7537bb5a service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:10.284787 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf845-8ba2-4e49-ba27-826e7537bb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:10.285075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf845-8ba2-4e49-ba27-826e7537bb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:10.296360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baf845-8ba2-4e49-ba27-826e7537bb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:10.297129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baf845-8ba2-4e49-ba27-826e7537bb5a service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:10.306937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1230/2446] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:10.674760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa74af6-0007-4b90-bacc-0021c05b7e26 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:10.676114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9fa74af6-0007-4b90-bacc-0021c05b7e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:10.687465 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa74af6-0007-4b90-bacc-0021c05b7e26 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:10.691954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:10.692747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:10.693006 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:10.693285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] PATH_INFO: `/v3/projects/7ab2ce0456734d86a348b91b01c6faaa` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:10.694350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab2ce0456734d86a348b91b01c6faaa)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:10.696293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:10.744918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab2ce0456734d86a348b91b01c6faaa', 'request_id': 'req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.749715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab2ce0456734d86a348b91b01c6faaa', 'request_id': 'req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.757029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab2ce0456734d86a348b91b01c6faaa', 'request_id': 'req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.774623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] The token cache is being invalidate because project 7ab2ce0456734d86a348b91b01c6faaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:10.774914 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.775566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.777090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1217/2447] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:10 2021] DELETE /identity/v3/projects/7ab2ce0456734d86a348b91b01c6faaa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:10.781873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf845-8ba2-4e49-ba27-826e7537bb5a service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:10.791346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf845-8ba2-4e49-ba27-826e7537bb5a service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:10.855856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:10.856992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:10.857280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:10.857559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] PATH_INFO: `/v3/users/fae02ca47ce74932b5c4358c8d4ccea6` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:10.858736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae02ca47ce74932b5c4358c8d4ccea6)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:10.860671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:10.914248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae02ca47ce74932b5c4358c8d4ccea6'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.921789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae02ca47ce74932b5c4358c8d4ccea6'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.922548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae02ca47ce74932b5c4358c8d4ccea6'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.923239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae02ca47ce74932b5c4358c8d4ccea6'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.935965 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae02ca47ce74932b5c4358c8d4ccea6'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:10.949765 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1231/2448] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:10 2021] DELETE /identity/v3/users/fae02ca47ce74932b5c4358c8d4ccea6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:11.370610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:11.372396 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:11.386610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcf9ac-e2f0-4ca5-b298-8ec4f1840ab3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:11.418862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:11.420275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:11.455084 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:11.455921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.456210 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.456498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] PATH_INFO: `/v3/projects/7fcd9535ab394445a7ccb380652b981b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.457626 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcd9535ab394445a7ccb380652b981b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:11.459569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:11.501615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8913b-1c15-4697-b82a-bb7071ee5f79 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:11.516335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcd9535ab394445a7ccb380652b981b', 'request_id': 'req-e6750f09-f108-452e-bd58-d4966ad4ff95'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:11.521808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcd9535ab394445a7ccb380652b981b', 'request_id': 'req-e6750f09-f108-452e-bd58-d4966ad4ff95'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:11.529698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcd9535ab394445a7ccb380652b981b', 'request_id': 'req-e6750f09-f108-452e-bd58-d4966ad4ff95'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:11.546931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] The token cache is being invalidate because project 7fcd9535ab394445a7ccb380652b981b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:11.547213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:11.547857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6750f09-f108-452e-bd58-d4966ad4ff95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:11.549441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1218/2449] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:11 2021] DELETE /identity/v3/projects/7fcd9535ab394445a7ccb380652b981b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:11.554744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605bbc7-42f9-4a79-9034-eea7aa93d4eb None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.555031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605bbc7-42f9-4a79-9034-eea7aa93d4eb None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.555312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605bbc7-42f9-4a79-9034-eea7aa93d4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.561897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:11.563295 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.563733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.564021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.565758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:11.577816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6605bbc7-42f9-4a79-9034-eea7aa93d4eb None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:11.578976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6605bbc7-42f9-4a79-9034-eea7aa93d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:11.646047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:11.647433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:11.653553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1219/2450] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:02:11.658674 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1232/2451] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:11 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:02:11.661954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc3bd4-9942-44d7-abb2-66199a28176e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.662247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc3bd4-9942-44d7-abb2-66199a28176e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.662558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc3bd4-9942-44d7-abb2-66199a28176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.685327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-57cc3bd4-9942-44d7-abb2-66199a28176e None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:11.686495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-57cc3bd4-9942-44d7-abb2-66199a28176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:11.693815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1220/2452] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:11.697960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:11.707946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb7891-6438-4a14-b251-c91cba570af9 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:11.712335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:11.712959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.713214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.713497 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.714183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:02:11.714509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:11.716090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:11.729379 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1233/2453] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:02:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:02:11.734616 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc3bd4-9942-44d7-abb2-66199a28176e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:11.743336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc3bd4-9942-44d7-abb2-66199a28176e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:11.748226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0c30-4fa1-4ff7-a23c-299718ba8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:11.748813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0c30-4fa1-4ff7-a23c-299718ba8a49 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.749101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0c30-4fa1-4ff7-a23c-299718ba8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.749413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0c30-4fa1-4ff7-a23c-299718ba8a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.750115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f0c30-4fa1-4ff7-a23c-299718ba8a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:11.751977 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f0c30-4fa1-4ff7-a23c-299718ba8a49 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:11.778894 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1221/2454] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:11 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:02:11.783555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:11.794834 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d978849-242e-4dc7-9100-528f2a198487 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:11.864249 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926bb37-6833-45c2-afa3-71dc84b560da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:11.864856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926bb37-6833-45c2-afa3-71dc84b560da admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.865148 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926bb37-6833-45c2-afa3-71dc84b560da admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.865430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926bb37-6833-45c2-afa3-71dc84b560da admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.866106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926bb37-6833-45c2-afa3-71dc84b560da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:11.868079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926bb37-6833-45c2-afa3-71dc84b560da admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:11.886079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1234/2455] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:11 2021] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:11.890208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0c30-4fa1-4ff7-a23c-299718ba8a49 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:11.900177 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0c30-4fa1-4ff7-a23c-299718ba8a49 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:11.904686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14731170-52ba-4327-bea3-ef9a3d76af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:11.905274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14731170-52ba-4327-bea3-ef9a3d76af5e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.905562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14731170-52ba-4327-bea3-ef9a3d76af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.906356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14731170-52ba-4327-bea3-ef9a3d76af5e admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.907084 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14731170-52ba-4327-bea3-ef9a3d76af5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:11.908667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14731170-52ba-4327-bea3-ef9a3d76af5e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:11.919302 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1222/2456] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:11.924025 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926bb37-6833-45c2-afa3-71dc84b560da admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:11.934059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926bb37-6833-45c2-afa3-71dc84b560da admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:11.938603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ca89-8d50-4798-883c-ade7220a86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:11.939202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ca89-8d50-4798-883c-ade7220a86f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.939491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ca89-8d50-4798-883c-ade7220a86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.939775 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ca89-8d50-4798-883c-ade7220a86f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.940463 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44ca89-8d50-4798-883c-ade7220a86f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:11.942045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44ca89-8d50-4798-883c-ade7220a86f2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:11.952291 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1235/2457] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:11.956638 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14731170-52ba-4327-bea3-ef9a3d76af5e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:11.968077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14731170-52ba-4327-bea3-ef9a3d76af5e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:11.973230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20d0d8-e053-410d-af5c-1d30b8ef6a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:11.974012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20d0d8-e053-410d-af5c-1d30b8ef6a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:11.974336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20d0d8-e053-410d-af5c-1d30b8ef6a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:11.974692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20d0d8-e053-410d-af5c-1d30b8ef6a84 admin admin] PATH_INFO: `/v3/projects/c68cd578e0474ea4848a03ac93be35f0/users/378118f4f839474f92017a90698af9ce/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:11.994901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20d0d8-e053-410d-af5c-1d30b8ef6a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68cd578e0474ea4848a03ac93be35f0, user_id=378118f4f839474f92017a90698af9ce, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:11.997510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20d0d8-e053-410d-af5c-1d30b8ef6a84 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.010784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1223/2458] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:11 2021] PUT /identity/v3/projects/c68cd578e0474ea4848a03ac93be35f0/users/378118f4f839474f92017a90698af9ce/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:12.021509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0e72e-6356-4352-9851-88a4a3a44968 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.021919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0e72e-6356-4352-9851-88a4a3a44968 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.022212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0e72e-6356-4352-9851-88a4a3a44968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.057981 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1fb0e72e-6356-4352-9851-88a4a3a44968 None None] MFA Rules not processed for user `378118f4f839474f92017a90698af9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:12.059196 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1fb0e72e-6356-4352-9851-88a4a3a44968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:12.134270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1236/2459] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:12 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:12.138790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20d0d8-e053-410d-af5c-1d30b8ef6a84 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.209696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20d0d8-e053-410d-af5c-1d30b8ef6a84 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.214114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbd225-15a8-4f90-b078-31bf3da61bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.214747 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd225-15a8-4f90-b078-31bf3da61bcf admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.215022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd225-15a8-4f90-b078-31bf3da61bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.215297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd225-15a8-4f90-b078-31bf3da61bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.215945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbd225-15a8-4f90-b078-31bf3da61bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.217817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbd225-15a8-4f90-b078-31bf3da61bcf admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.249437 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1224/2460] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:12 2021] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:02:12.254292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0e72e-6356-4352-9851-88a4a3a44968 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.269057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0e72e-6356-4352-9851-88a4a3a44968 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.344053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70710aba-d331-4b90-a08d-ec556d61348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.344682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710aba-d331-4b90-a08d-ec556d61348d admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.344968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710aba-d331-4b90-a08d-ec556d61348d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.345253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710aba-d331-4b90-a08d-ec556d61348d admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.345910 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70710aba-d331-4b90-a08d-ec556d61348d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.347875 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70710aba-d331-4b90-a08d-ec556d61348d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.369940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1237/2461] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:12 2021] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:12.374118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbd225-15a8-4f90-b078-31bf3da61bcf admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.385003 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbd225-15a8-4f90-b078-31bf3da61bcf admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.389669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d67f-c777-48a6-b0d4-a2a9e7695cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.390306 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d67f-c777-48a6-b0d4-a2a9e7695cfe admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.390729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d67f-c777-48a6-b0d4-a2a9e7695cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.391409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d67f-c777-48a6-b0d4-a2a9e7695cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.392135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5d67f-c777-48a6-b0d4-a2a9e7695cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.393762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5d67f-c777-48a6-b0d4-a2a9e7695cfe admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.408373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1225/2462] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:12.410010 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70710aba-d331-4b90-a08d-ec556d61348d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.419725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70710aba-d331-4b90-a08d-ec556d61348d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.424208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3adfd-02e8-47de-9644-5def82fe9bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.424798 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3adfd-02e8-47de-9644-5def82fe9bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.425082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3adfd-02e8-47de-9644-5def82fe9bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.425360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3adfd-02e8-47de-9644-5def82fe9bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.426044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3adfd-02e8-47de-9644-5def82fe9bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.427653 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3adfd-02e8-47de-9644-5def82fe9bf8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.438131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1238/2463] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:02:12.442341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d67f-c777-48a6-b0d4-a2a9e7695cfe admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.451983 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d67f-c777-48a6-b0d4-a2a9e7695cfe admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.457682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69f435-4c41-4f64-90ac-2f3eca2d8486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.458524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f435-4c41-4f64-90ac-2f3eca2d8486 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.458812 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f435-4c41-4f64-90ac-2f3eca2d8486 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.459085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f435-4c41-4f64-90ac-2f3eca2d8486 admin admin] PATH_INFO: `/v3/projects/1cbac745ddf24082ba563f55e334dbf8/users/68c4b8a7acfe4bc6ad8f9f6dff624989/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.480474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69f435-4c41-4f64-90ac-2f3eca2d8486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbac745ddf24082ba563f55e334dbf8, user_id=68c4b8a7acfe4bc6ad8f9f6dff624989, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.483422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69f435-4c41-4f64-90ac-2f3eca2d8486 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.497072 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1226/2464] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:12 2021] PUT /identity/v3/projects/1cbac745ddf24082ba563f55e334dbf8/users/68c4b8a7acfe4bc6ad8f9f6dff624989/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:12.508894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885275-38d5-4b5e-8ad3-b9467014a9c4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.509195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885275-38d5-4b5e-8ad3-b9467014a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.509505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885275-38d5-4b5e-8ad3-b9467014a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.546124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-d3885275-38d5-4b5e-8ad3-b9467014a9c4 None None] MFA Rules not processed for user `68c4b8a7acfe4bc6ad8f9f6dff624989`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:12.547444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d3885275-38d5-4b5e-8ad3-b9467014a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:12.628974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1239/2465] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:12 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:12.633493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69f435-4c41-4f64-90ac-2f3eca2d8486 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.707051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69f435-4c41-4f64-90ac-2f3eca2d8486 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.712902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79736d-e862-44c6-b3cd-bb65b1977211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.713541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79736d-e862-44c6-b3cd-bb65b1977211 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.713832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79736d-e862-44c6-b3cd-bb65b1977211 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.714122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79736d-e862-44c6-b3cd-bb65b1977211 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.715009 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79736d-e862-44c6-b3cd-bb65b1977211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.716799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79736d-e862-44c6-b3cd-bb65b1977211 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.745136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1227/2466] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:12 2021] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:02:12.749245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3885275-38d5-4b5e-8ad3-b9467014a9c4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.760901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3885275-38d5-4b5e-8ad3-b9467014a9c4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.832069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b5906-7cfa-43d9-aaf5-26de81ea700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.832813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b5906-7cfa-43d9-aaf5-26de81ea700b admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.833263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b5906-7cfa-43d9-aaf5-26de81ea700b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.833553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b5906-7cfa-43d9-aaf5-26de81ea700b admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.834201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b5906-7cfa-43d9-aaf5-26de81ea700b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.836317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b5906-7cfa-43d9-aaf5-26de81ea700b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.864386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1240/2467] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:12 2021] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:12.864822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79736d-e862-44c6-b3cd-bb65b1977211 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.876690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79736d-e862-44c6-b3cd-bb65b1977211 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.881499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3497b07-e4ab-4d22-8ef8-6090945e123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.882119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497b07-e4ab-4d22-8ef8-6090945e123e admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.882422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497b07-e4ab-4d22-8ef8-6090945e123e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.882716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497b07-e4ab-4d22-8ef8-6090945e123e admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.883557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3497b07-e4ab-4d22-8ef8-6090945e123e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.885143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3497b07-e4ab-4d22-8ef8-6090945e123e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.896571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1228/2468] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:02:12.900598 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b5906-7cfa-43d9-aaf5-26de81ea700b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.911029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b5906-7cfa-43d9-aaf5-26de81ea700b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:12.916186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b398b-c90c-4624-a9b4-fa09b60f96a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:12.917024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b398b-c90c-4624-a9b4-fa09b60f96a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:12.917312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b398b-c90c-4624-a9b4-fa09b60f96a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:12.917590 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b398b-c90c-4624-a9b4-fa09b60f96a0 admin admin] PATH_INFO: `/v3/projects/95cbe840150d4fd9b37a14064ef68084/users/deb4a6b77ccd431a9f10a3ad8c6d6ea9/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:12.941499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b398b-c90c-4624-a9b4-fa09b60f96a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cbe840150d4fd9b37a14064ef68084, user_id=deb4a6b77ccd431a9f10a3ad8c6d6ea9, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:12.944323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b398b-c90c-4624-a9b4-fa09b60f96a0 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:12.959680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1241/2469] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:12 2021] PUT /identity/v3/projects/95cbe840150d4fd9b37a14064ef68084/users/deb4a6b77ccd431a9f10a3ad8c6d6ea9/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:12.963731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3497b07-e4ab-4d22-8ef8-6090945e123e admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:12.974193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3497b07-e4ab-4d22-8ef8-6090945e123e admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:13.044750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede40f7-1df6-415a-bb21-18c7df664d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:13.045700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede40f7-1df6-415a-bb21-18c7df664d1d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:13.045989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede40f7-1df6-415a-bb21-18c7df664d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:13.046816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede40f7-1df6-415a-bb21-18c7df664d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:13.047532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede40f7-1df6-415a-bb21-18c7df664d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:13.049342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede40f7-1df6-415a-bb21-18c7df664d1d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:13.067926 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1229/2470] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:12 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:02:13.070067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b398b-c90c-4624-a9b4-fa09b60f96a0 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:13.087850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b398b-c90c-4624-a9b4-fa09b60f96a0 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:13.095503 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:13.097013 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:13.097537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:13.098088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] PATH_INFO: `/v3/projects/95cbe840150d4fd9b37a14064ef68084/users/deb4a6b77ccd431a9f10a3ad8c6d6ea9/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:13.101307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cbe840150d4fd9b37a14064ef68084, user_id=deb4a6b77ccd431a9f10a3ad8c6d6ea9, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:13.106888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:13.126194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1242/2471] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:13 2021] PUT /identity/v3/projects/95cbe840150d4fd9b37a14064ef68084/users/deb4a6b77ccd431a9f10a3ad8c6d6ea9/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:13.143217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643e6d-f272-4b1d-a268-3695dcdfb5f5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:13.143855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643e6d-f272-4b1d-a268-3695dcdfb5f5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:13.144217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643e6d-f272-4b1d-a268-3695dcdfb5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:13.188834 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-2a643e6d-f272-4b1d-a268-3695dcdfb5f5 None None] MFA Rules not processed for user `deb4a6b77ccd431a9f10a3ad8c6d6ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:13.189994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2a643e6d-f272-4b1d-a268-3695dcdfb5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:13.274434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1230/2472] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:13 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:13.285407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:13.287310 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:13.364615 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23138b-c03a-42cd-9fe6-e150566d2829 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:13.368572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:13.369164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:13.369459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:13.369740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:13.434050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:13.435504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:13.444605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1243/2473] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:13 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:15.173719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a643e6d-f272-4b1d-a268-3695dcdfb5f5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:15.175019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2a643e6d-f272-4b1d-a268-3695dcdfb5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:15.186473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a643e6d-f272-4b1d-a268-3695dcdfb5f5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:15.189843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133de591-e539-4440-98a1-a60feb0f3b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:15.190436 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133de591-e539-4440-98a1-a60feb0f3b85 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:15.190729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133de591-e539-4440-98a1-a60feb0f3b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:15.191015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133de591-e539-4440-98a1-a60feb0f3b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:15.252439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133de591-e539-4440-98a1-a60feb0f3b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:15.253859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133de591-e539-4440-98a1-a60feb0f3b85 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:15.262275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1231/2474] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:15 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:15.738217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:15.739751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:15.819139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9d5d5-48ac-4e24-b23e-42ca74906260 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:15.819139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:15.819479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:15.819577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:15.819855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:15.830677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:15.941202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:15.941202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:15.946083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1244/2475] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:15 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:16.074750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133de591-e539-4440-98a1-a60feb0f3b85 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:16.083582 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133de591-e539-4440-98a1-a60feb0f3b85 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:16.087612 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e784b-98e6-4ffe-ae1b-1d6668585ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:16.088215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e784b-98e6-4ffe-ae1b-1d6668585ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:16.088500 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e784b-98e6-4ffe-ae1b-1d6668585ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:16.088779 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e784b-98e6-4ffe-ae1b-1d6668585ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:16.103496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e784b-98e6-4ffe-ae1b-1d6668585ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:16.104944 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e784b-98e6-4ffe-ae1b-1d6668585ce8 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:16.117216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1232/2476] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:16 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:20.747595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:20.826450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d617-5d6a-4c77-8143-5f1c2e1a153a service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:20.832258 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:20.833102 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:20.833401 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:20.833689 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] PATH_INFO: `/v3/users/378118f4f839474f92017a90698af9ce` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:20.834971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378118f4f839474f92017a90698af9ce)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:20.836953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:20.892964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378118f4f839474f92017a90698af9ce'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:20.900940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378118f4f839474f92017a90698af9ce'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:20.901608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378118f4f839474f92017a90698af9ce'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:20.902222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378118f4f839474f92017a90698af9ce'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:20.915925 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378118f4f839474f92017a90698af9ce'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:20.929224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1245/2477] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:20 2021] DELETE /identity/v3/users/378118f4f839474f92017a90698af9ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:20.933878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66d737-65af-42ae-85b8-93194f63b0d1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:20.934393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66d737-65af-42ae-85b8-93194f63b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:20.934557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66d737-65af-42ae-85b8-93194f63b0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:20.963206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-4f66d737-65af-42ae-85b8-93194f63b0d1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:20.965082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4f66d737-65af-42ae-85b8-93194f63b0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:21.043715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1233/2478] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:02:21.055880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:21.057265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:21.140163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c2684-342a-4c0e-a5a5-6614de38cfe7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:21.143766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91d74-06df-4036-b076-ee5f5e02117c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:21.144357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91d74-06df-4036-b076-ee5f5e02117c service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:21.144644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91d74-06df-4036-b076-ee5f5e02117c service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:21.144926 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91d74-06df-4036-b076-ee5f5e02117c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:21.155355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf91d74-06df-4036-b076-ee5f5e02117c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:21.156860 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf91d74-06df-4036-b076-ee5f5e02117c service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:21.166839 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1246/2479] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:21.578935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66d737-65af-42ae-85b8-93194f63b0d1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:21.580722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4f66d737-65af-42ae-85b8-93194f63b0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:21.591949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66d737-65af-42ae-85b8-93194f63b0d1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:21.596782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:21.597565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:21.597858 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:21.598141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] PATH_INFO: `/v3/projects/c68cd578e0474ea4848a03ac93be35f0` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:21.599286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68cd578e0474ea4848a03ac93be35f0)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:21.601173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:21.657492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68cd578e0474ea4848a03ac93be35f0', 'request_id': 'req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.663231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68cd578e0474ea4848a03ac93be35f0', 'request_id': 'req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.671953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68cd578e0474ea4848a03ac93be35f0', 'request_id': 'req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.688275 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] The token cache is being invalidate because project c68cd578e0474ea4848a03ac93be35f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:21.688553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.689210 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.690708 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1234/2480] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:21 2021] DELETE /identity/v3/projects/c68cd578e0474ea4848a03ac93be35f0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:21.695502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91d74-06df-4036-b076-ee5f5e02117c service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:21.705355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91d74-06df-4036-b076-ee5f5e02117c service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:21.768549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:21.769356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:21.769638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:21.769911 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] PATH_INFO: `/v3/users/68c4b8a7acfe4bc6ad8f9f6dff624989` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:21.771183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c4b8a7acfe4bc6ad8f9f6dff624989)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:21.773121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:21.825188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c4b8a7acfe4bc6ad8f9f6dff624989'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.832790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c4b8a7acfe4bc6ad8f9f6dff624989'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.833594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c4b8a7acfe4bc6ad8f9f6dff624989'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.834273 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c4b8a7acfe4bc6ad8f9f6dff624989'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.846420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c4b8a7acfe4bc6ad8f9f6dff624989'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:21.859241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1247/2481] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:21 2021] DELETE /identity/v3/users/68c4b8a7acfe4bc6ad8f9f6dff624989 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:22.252374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:22.254704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:22.273235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b659-b065-4ea8-83c9-c115de4fbbcd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:22.347131 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:22.348304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:22.348589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:22.348870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] PATH_INFO: `/v3/projects/1cbac745ddf24082ba563f55e334dbf8` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:22.350091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbac745ddf24082ba563f55e334dbf8)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:22.352018 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:22.406364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbac745ddf24082ba563f55e334dbf8', 'request_id': 'req-e5954ba1-f59d-4007-afa3-e59180f98c4f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.412001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbac745ddf24082ba563f55e334dbf8', 'request_id': 'req-e5954ba1-f59d-4007-afa3-e59180f98c4f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.419087 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbac745ddf24082ba563f55e334dbf8', 'request_id': 'req-e5954ba1-f59d-4007-afa3-e59180f98c4f'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.435413 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] The token cache is being invalidate because project 1cbac745ddf24082ba563f55e334dbf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:22.436015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.436657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.438621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1235/2482] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:22 2021] DELETE /identity/v3/projects/1cbac745ddf24082ba563f55e334dbf8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:22.442576 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:22.443905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:22.457916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4626f-b5be-4f00-8f3a-9c84e493a7d5 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:22.522124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:22.522884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:22.523308 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:22.523602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] PATH_INFO: `/v3/users/deb4a6b77ccd431a9f10a3ad8c6d6ea9` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:22.524713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb4a6b77ccd431a9f10a3ad8c6d6ea9)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:22.526656 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:22.578856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb4a6b77ccd431a9f10a3ad8c6d6ea9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.587225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb4a6b77ccd431a9f10a3ad8c6d6ea9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.587836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb4a6b77ccd431a9f10a3ad8c6d6ea9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.588460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb4a6b77ccd431a9f10a3ad8c6d6ea9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.600708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-e29da0da-fdd8-4485-9b73-e51fa926975c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb4a6b77ccd431a9f10a3ad8c6d6ea9'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:22.615073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1248/2483] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:22 2021] DELETE /identity/v3/users/deb4a6b77ccd431a9f10a3ad8c6d6ea9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:22.994368 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:22.995895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:23.009619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954ba1-f59d-4007-afa3-e59180f98c4f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:23.074973 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:23.075647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.075934 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.076217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] PATH_INFO: `/v3/projects/95cbe840150d4fd9b37a14064ef68084` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.077354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cbe840150d4fd9b37a14064ef68084)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:23.079259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:23.128501 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cbe840150d4fd9b37a14064ef68084', 'request_id': 'req-edec7955-8d70-4003-8826-20410cb00c79'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:23.133522 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cbe840150d4fd9b37a14064ef68084', 'request_id': 'req-edec7955-8d70-4003-8826-20410cb00c79'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:23.141963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cbe840150d4fd9b37a14064ef68084', 'request_id': 'req-edec7955-8d70-4003-8826-20410cb00c79'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:23.158850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] The token cache is being invalidate because project 95cbe840150d4fd9b37a14064ef68084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:23.159134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:23.159777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-edec7955-8d70-4003-8826-20410cb00c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:23.161221 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1236/2484] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:22 2021] DELETE /identity/v3/projects/95cbe840150d4fd9b37a14064ef68084 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:23.166876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789315a-491c-4545-a746-462812191299 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.167365 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789315a-491c-4545-a746-462812191299 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.167466 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789315a-491c-4545-a746-462812191299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.190540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e789315a-491c-4545-a746-462812191299 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:23.191727 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e789315a-491c-4545-a746-462812191299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:23.261681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1249/2485] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:23.269968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a5d9-6e6f-4b34-b94d-c3b6bcd51f90 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.270534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a5d9-6e6f-4b34-b94d-c3b6bcd51f90 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.270655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a5d9-6e6f-4b34-b94d-c3b6bcd51f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.293326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e669a5d9-6e6f-4b34-b94d-c3b6bcd51f90 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:23.294548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e669a5d9-6e6f-4b34-b94d-c3b6bcd51f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:23.302293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1237/2486] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:23.306747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789315a-491c-4545-a746-462812191299 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:23.316204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789315a-491c-4545-a746-462812191299 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:23.320586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:23.321187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.321475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.321757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.322487 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:02:23.322794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:23.324384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:23.337903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1250/2487] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:02:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:02:23.342351 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669a5d9-6e6f-4b34-b94d-c3b6bcd51f90 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:23.351986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669a5d9-6e6f-4b34-b94d-c3b6bcd51f90 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:23.356698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffef70-9162-4066-867b-d9d841caa8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:23.357278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffef70-9162-4066-867b-d9d841caa8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.357567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffef70-9162-4066-867b-d9d841caa8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.357850 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffef70-9162-4066-867b-d9d841caa8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.358570 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffef70-9162-4066-867b-d9d841caa8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:23.360442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffef70-9162-4066-867b-d9d841caa8a3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:23.386947 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1238/2488] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:23 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:23.391694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:23.401319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a6d8a-7cb3-48a5-87ca-f213fac61089 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:23.471225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245fae8-bc36-408c-b433-a952322ba72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:23.471845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245fae8-bc36-408c-b433-a952322ba72a admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.472298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245fae8-bc36-408c-b433-a952322ba72a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.472416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245fae8-bc36-408c-b433-a952322ba72a admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.473176 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245fae8-bc36-408c-b433-a952322ba72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:23.474985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245fae8-bc36-408c-b433-a952322ba72a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:23.495724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1251/2489] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:23 2021] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:23.499855 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffef70-9162-4066-867b-d9d841caa8a3 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:23.509999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffef70-9162-4066-867b-d9d841caa8a3 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:23.514716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ef543-d63d-4f20-ac14-a12ea2f4d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:23.516190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ef543-d63d-4f20-ac14-a12ea2f4d305 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.516483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ef543-d63d-4f20-ac14-a12ea2f4d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.516763 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ef543-d63d-4f20-ac14-a12ea2f4d305 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.517462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ef543-d63d-4f20-ac14-a12ea2f4d305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:23.519074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ef543-d63d-4f20-ac14-a12ea2f4d305 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:23.529485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1239/2490] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:23.534094 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245fae8-bc36-408c-b433-a952322ba72a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:23.544902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245fae8-bc36-408c-b433-a952322ba72a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:23.549418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0f3f2-a17c-4194-8807-743d633ef3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:23.550015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0f3f2-a17c-4194-8807-743d633ef3da admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.550298 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0f3f2-a17c-4194-8807-743d633ef3da admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.550613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0f3f2-a17c-4194-8807-743d633ef3da admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.551305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0f3f2-a17c-4194-8807-743d633ef3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:23.552912 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0f3f2-a17c-4194-8807-743d633ef3da admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:23.562993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1252/2491] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:23.567269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ef543-d63d-4f20-ac14-a12ea2f4d305 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:23.576952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ef543-d63d-4f20-ac14-a12ea2f4d305 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:23.581937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:23.582778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.583229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.583358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] PATH_INFO: `/v3/projects/dc49729eb820425fa7274a3cede63f88/users/1e327f1681c24d1fad6f12bd48c00ffc/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.602951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc49729eb820425fa7274a3cede63f88, user_id=1e327f1681c24d1fad6f12bd48c00ffc, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:23.605481 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:23.619749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1240/2492] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:23 2021] PUT /identity/v3/projects/dc49729eb820425fa7274a3cede63f88/users/1e327f1681c24d1fad6f12bd48c00ffc/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:23.631950 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023db1c-5a76-4906-8dcd-0612f0f970e6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.632241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023db1c-5a76-4906-8dcd-0612f0f970e6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.632525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023db1c-5a76-4906-8dcd-0612f0f970e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.669122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-4023db1c-5a76-4906-8dcd-0612f0f970e6 None None] MFA Rules not processed for user `1e327f1681c24d1fad6f12bd48c00ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:23.670286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4023db1c-5a76-4906-8dcd-0612f0f970e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:23.755098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1253/2493] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:23 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:23.765737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:23.768140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:23.838809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3817129-6472-4604-a812-fead8ca09c8b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:23.842360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136384e-8deb-4574-9b9b-029aa290cdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:23.843244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136384e-8deb-4574-9b9b-029aa290cdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:23.843562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136384e-8deb-4574-9b9b-029aa290cdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:23.843846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136384e-8deb-4574-9b9b-029aa290cdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:23.852931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136384e-8deb-4574-9b9b-029aa290cdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:23.854273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136384e-8deb-4574-9b9b-029aa290cdd2 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:23.863601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1241/2494] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:23 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:26.739921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023db1c-5a76-4906-8dcd-0612f0f970e6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:26.815154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023db1c-5a76-4906-8dcd-0612f0f970e6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:26.821531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:26.822486 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:26.822919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:26.823236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] PATH_INFO: `/v3/users/1e327f1681c24d1fad6f12bd48c00ffc` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:26.824494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e327f1681c24d1fad6f12bd48c00ffc)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:26.826529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:26.891727 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e327f1681c24d1fad6f12bd48c00ffc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:26.899170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e327f1681c24d1fad6f12bd48c00ffc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:26.899780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e327f1681c24d1fad6f12bd48c00ffc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:26.900388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e327f1681c24d1fad6f12bd48c00ffc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:26.912453 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e327f1681c24d1fad6f12bd48c00ffc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:26.927628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1254/2495] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:02:26 2021] DELETE /identity/v3/users/1e327f1681c24d1fad6f12bd48c00ffc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:26.932063 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b436f5-18f4-42a1-b579-3ef47933f1f6 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:26.932658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b436f5-18f4-42a1-b579-3ef47933f1f6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:26.932658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b436f5-18f4-42a1-b579-3ef47933f1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:26.955425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-45b436f5-18f4-42a1-b579-3ef47933f1f6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:26.956887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-45b436f5-18f4-42a1-b579-3ef47933f1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:27.036993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1242/2496] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:27.050840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:27.052212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:27.127633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40f09-5160-48f1-b784-ae134f0f2a65 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:27.131652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:27.132400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:27.132645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:27.132928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:27.143502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:27.144953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:27.164348 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1255/2497] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:02:27.221297 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b436f5-18f4-42a1-b579-3ef47933f1f6 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:27.222925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-45b436f5-18f4-42a1-b579-3ef47933f1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:27.303191 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b436f5-18f4-42a1-b579-3ef47933f1f6 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:27.306869 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614fc21-716c-4cdb-b96f-a52030d810d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:27.307459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fc21-716c-4cdb-b96f-a52030d810d8 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:27.307752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fc21-716c-4cdb-b96f-a52030d810d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:27.308038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fc21-716c-4cdb-b96f-a52030d810d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:27.311345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5614fc21-716c-4cdb-b96f-a52030d810d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:27.395776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614fc21-716c-4cdb-b96f-a52030d810d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:27.397489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614fc21-716c-4cdb-b96f-a52030d810d8 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:27.408744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1243/2498] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:27 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:02:27.585542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:27.587125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:27.601507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa546b0-6518-44ca-9446-d812a015790c service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:27.614943 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:27.616287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:27.616644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:27.616999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] PATH_INFO: `/v3/projects/dc49729eb820425fa7274a3cede63f88` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:27.618197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc49729eb820425fa7274a3cede63f88)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:27.620418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:27.682310 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc49729eb820425fa7274a3cede63f88', 'request_id': 'req-a434b41a-9c58-4205-b523-7651eb8e7884'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:27.690613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc49729eb820425fa7274a3cede63f88', 'request_id': 'req-a434b41a-9c58-4205-b523-7651eb8e7884'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:27.700004 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc49729eb820425fa7274a3cede63f88', 'request_id': 'req-a434b41a-9c58-4205-b523-7651eb8e7884'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:27.717134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] The token cache is being invalidate because project dc49729eb820425fa7274a3cede63f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:02:27.717422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:27.718655 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-a434b41a-9c58-4205-b523-7651eb8e7884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:02:27.720678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1256/2499] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:02:27 2021] DELETE /identity/v3/projects/dc49729eb820425fa7274a3cede63f88 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:27.728762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236564-42a0-4217-bb9c-5cf416a5286a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:27.728917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236564-42a0-4217-bb9c-5cf416a5286a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:27.729234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236564-42a0-4217-bb9c-5cf416a5286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:27.752877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-55236564-42a0-4217-bb9c-5cf416a5286a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:27.754043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-55236564-42a0-4217-bb9c-5cf416a5286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:27.824051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1244/2500] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:27.832738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359728c-2d16-41de-b90b-f33f7e429dfd None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:27.833301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359728c-2d16-41de-b90b-f33f7e429dfd None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:27.833696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359728c-2d16-41de-b90b-f33f7e429dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:27.860574 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0359728c-2d16-41de-b90b-f33f7e429dfd None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:27.861747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0359728c-2d16-41de-b90b-f33f7e429dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:27.869543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1257/2501] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:27.874097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55236564-42a0-4217-bb9c-5cf416a5286a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:27.883717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55236564-42a0-4217-bb9c-5cf416a5286a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:27.889057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:27.890279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:27.890719 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:27.891045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:27.891866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:02:27.892256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:27.894052 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:27.916369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1245/2502] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:02:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:02:27.917734 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359728c-2d16-41de-b90b-f33f7e429dfd None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:27.930553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359728c-2d16-41de-b90b-f33f7e429dfd None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:27.936183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865761f-f3c4-463e-a126-54971cda893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:27.936818 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865761f-f3c4-463e-a126-54971cda893d admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:27.937108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865761f-f3c4-463e-a126-54971cda893d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:27.937389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865761f-f3c4-463e-a126-54971cda893d admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:27.938041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865761f-f3c4-463e-a126-54971cda893d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:27.939982 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865761f-f3c4-463e-a126-54971cda893d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:27.969849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1258/2503] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:27 2021] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:27.974005 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:27.984096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9353902-adc8-43bf-8106-85fde767de81 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:28.049861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775600-d21c-4be9-a828-f63dbae63cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:28.050493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775600-d21c-4be9-a828-f63dbae63cdb admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:28.050780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775600-d21c-4be9-a828-f63dbae63cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:28.051055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775600-d21c-4be9-a828-f63dbae63cdb admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:28.051731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775600-d21c-4be9-a828-f63dbae63cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:28.054036 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775600-d21c-4be9-a828-f63dbae63cdb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:28.076235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1246/2504] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:27 2021] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:02:28.081557 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865761f-f3c4-463e-a126-54971cda893d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:28.092216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865761f-f3c4-463e-a126-54971cda893d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:28.097216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a978007-41a1-4a51-b66d-737fcdaf654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:28.097825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a978007-41a1-4a51-b66d-737fcdaf654d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:28.098117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a978007-41a1-4a51-b66d-737fcdaf654d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:28.098391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a978007-41a1-4a51-b66d-737fcdaf654d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:28.099142 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a978007-41a1-4a51-b66d-737fcdaf654d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:28.100793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a978007-41a1-4a51-b66d-737fcdaf654d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:28.111521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1259/2505] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:28.115503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775600-d21c-4be9-a828-f63dbae63cdb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:28.127371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775600-d21c-4be9-a828-f63dbae63cdb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:28.132488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abf3a2-19d3-4466-bb54-2d51348d0a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:28.133096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abf3a2-19d3-4466-bb54-2d51348d0a0d admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:28.133417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abf3a2-19d3-4466-bb54-2d51348d0a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:28.133702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abf3a2-19d3-4466-bb54-2d51348d0a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:28.134421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abf3a2-19d3-4466-bb54-2d51348d0a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:28.136030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abf3a2-19d3-4466-bb54-2d51348d0a0d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:28.147685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1247/2506] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:02:28.151946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a978007-41a1-4a51-b66d-737fcdaf654d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:28.167994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a978007-41a1-4a51-b66d-737fcdaf654d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:28.172760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:28.173850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:28.174302 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:28.174753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] PATH_INFO: `/v3/projects/25ba3a1600fd4be6bf9ece5e1fc524e5/users/8b6c5ce8a6e342b492f56c29d5f8b473/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:28.195534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ba3a1600fd4be6bf9ece5e1fc524e5, user_id=8b6c5ce8a6e342b492f56c29d5f8b473, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:28.198203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:28.214648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1260/2507] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:28 2021] PUT /identity/v3/projects/25ba3a1600fd4be6bf9ece5e1fc524e5/users/8b6c5ce8a6e342b492f56c29d5f8b473/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:28.219972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d96ad-5fce-47ce-98ef-82415f1d1116 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:28.220262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d96ad-5fce-47ce-98ef-82415f1d1116 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:28.220556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d96ad-5fce-47ce-98ef-82415f1d1116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:28.242339 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-9d2d96ad-5fce-47ce-98ef-82415f1d1116 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:28.243541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9d2d96ad-5fce-47ce-98ef-82415f1d1116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:28.309258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1248/2508] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:02:28.320017 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:28.321802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:28.394593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57af7df-1816-4e5a-8540-7830a3da369b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:28.398990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59b10f-bb44-45dc-a9ee-add1acbde8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:28.399613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59b10f-bb44-45dc-a9ee-add1acbde8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:28.399895 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59b10f-bb44-45dc-a9ee-add1acbde8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:28.400212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59b10f-bb44-45dc-a9ee-add1acbde8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:28.410852 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59b10f-bb44-45dc-a9ee-add1acbde8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:28.412300 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59b10f-bb44-45dc-a9ee-add1acbde8f5 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:28.424327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1261/2509] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:37.562344 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb90e4-18e4-4100-90ef-41fa9663d461 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:37.562906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb90e4-18e4-4100-90ef-41fa9663d461 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:37.563025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb90e4-18e4-4100-90ef-41fa9663d461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:37.606755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-37eb90e4-18e4-4100-90ef-41fa9663d461 None None] MFA Rules not processed for user `8b6c5ce8a6e342b492f56c29d5f8b473`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:37.608594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-37eb90e4-18e4-4100-90ef-41fa9663d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:37.709172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1249/2510] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:37 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:37.713728 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59b10f-bb44-45dc-a9ee-add1acbde8f5 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:37.724367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59b10f-bb44-45dc-a9ee-add1acbde8f5 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:37.734634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55e652-830d-424b-a2e9-3e507759dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:37.735354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e652-830d-424b-a2e9-3e507759dc80 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:37.735770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e652-830d-424b-a2e9-3e507759dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:37.736402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e652-830d-424b-a2e9-3e507759dc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:37.737027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55e652-830d-424b-a2e9-3e507759dc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:37.739672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55e652-830d-424b-a2e9-3e507759dc80 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:37.777008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1262/2511] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:02:37 2021] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:02:37.781335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb90e4-18e4-4100-90ef-41fa9663d461 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:37.797625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb90e4-18e4-4100-90ef-41fa9663d461 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:37.899286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b5d24-0a76-4ecf-b0e5-72567b0c3247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:37.900487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5d24-0a76-4ecf-b0e5-72567b0c3247 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:37.900487 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5d24-0a76-4ecf-b0e5-72567b0c3247 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:37.900773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5d24-0a76-4ecf-b0e5-72567b0c3247 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:37.901547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b5d24-0a76-4ecf-b0e5-72567b0c3247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:37.903764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b5d24-0a76-4ecf-b0e5-72567b0c3247 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:37.940166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1250/2512] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:02:37 2021] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:02:37.944103 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55e652-830d-424b-a2e9-3e507759dc80 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:37.956099 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55e652-830d-424b-a2e9-3e507759dc80 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:37.961733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fce33-a005-4f56-88eb-e3b0c8851b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:37.962351 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fce33-a005-4f56-88eb-e3b0c8851b28 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:37.962672 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fce33-a005-4f56-88eb-e3b0c8851b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:37.962956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fce33-a005-4f56-88eb-e3b0c8851b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:37.963652 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fce33-a005-4f56-88eb-e3b0c8851b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:37.965367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fce33-a005-4f56-88eb-e3b0c8851b28 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:37.980823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1263/2513] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:37 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:37.982001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b5d24-0a76-4ecf-b0e5-72567b0c3247 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:37.993561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b5d24-0a76-4ecf-b0e5-72567b0c3247 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:38.001448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196af24-fb91-4a06-8f65-d4f3ac6309a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:38.002647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196af24-fb91-4a06-8f65-d4f3ac6309a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:38.003010 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196af24-fb91-4a06-8f65-d4f3ac6309a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:38.003366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196af24-fb91-4a06-8f65-d4f3ac6309a2 admin admin] PATH_INFO: `/v3/projects/b8e4cc3babfe4acbbf4dec7921b88394/users/475c710c78ce4d7680cb5f1da29863fc/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:38.031467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196af24-fb91-4a06-8f65-d4f3ac6309a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e4cc3babfe4acbbf4dec7921b88394, user_id=475c710c78ce4d7680cb5f1da29863fc, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:38.034181 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196af24-fb91-4a06-8f65-d4f3ac6309a2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:38.050491 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1251/2514] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:37 2021] PUT /identity/v3/projects/b8e4cc3babfe4acbbf4dec7921b88394/users/475c710c78ce4d7680cb5f1da29863fc/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:02:38.053809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fce33-a005-4f56-88eb-e3b0c8851b28 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:38.064711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fce33-a005-4f56-88eb-e3b0c8851b28 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:38.166427 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4549a-7896-4ea1-bd67-c79907320923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:38.167918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4549a-7896-4ea1-bd67-c79907320923 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:38.168286 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4549a-7896-4ea1-bd67-c79907320923 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:38.168873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4549a-7896-4ea1-bd67-c79907320923 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:38.170483 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4549a-7896-4ea1-bd67-c79907320923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:38.173489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4549a-7896-4ea1-bd67-c79907320923 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:38.193178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1264/2515] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:02:38 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:02:38.193313 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196af24-fb91-4a06-8f65-d4f3ac6309a2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:38.206109 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196af24-fb91-4a06-8f65-d4f3ac6309a2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:38.211108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:38.211996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:38.212289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:38.212574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] PATH_INFO: `/v3/projects/b8e4cc3babfe4acbbf4dec7921b88394/users/475c710c78ce4d7680cb5f1da29863fc/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:38.214545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e4cc3babfe4acbbf4dec7921b88394, user_id=475c710c78ce4d7680cb5f1da29863fc, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:38.217394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:38.228967 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1252/2516] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:02:38 2021] PUT /identity/v3/projects/b8e4cc3babfe4acbbf4dec7921b88394/users/475c710c78ce4d7680cb5f1da29863fc/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:02:39.916071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187029-06a6-4426-a6ed-f33e763f11a4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:39.916934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187029-06a6-4426-a6ed-f33e763f11a4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:39.917436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187029-06a6-4426-a6ed-f33e763f11a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:39.966188 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7b187029-06a6-4426-a6ed-f33e763f11a4 None None] MFA Rules not processed for user `aa6c8c2103534ca28f981d39cecb2c70`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:39.968933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7b187029-06a6-4426-a6ed-f33e763f11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:40.081739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1265/2517] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:39 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:41.271746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:41.274815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:41.398697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9367bc-a211-48bf-9793-5ab13bd058d7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:41.405645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:41.406390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:41.409653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:41.410201 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:41.412284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:41.424363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:41.427007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:41.441334 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1253/2518] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:41 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:42.223034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b187029-06a6-4426-a6ed-f33e763f11a4 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:42.225736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7b187029-06a6-4426-a6ed-f33e763f11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:42.397383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b187029-06a6-4426-a6ed-f33e763f11a4 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:42.411391 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:42.412435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:42.412714 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:42.413170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:42.416660 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:42.430138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:42.432023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:42.457670 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1266/2519] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:42 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:42.591231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:42.592682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:42.608435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7bdc-c745-40cf-ba73-d63da013d52e service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:42.616158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:42.618122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:42.618991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:42.619862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:42.623230 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:42.641471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:42.645748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:42.660895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1254/2520] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:42 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:46.997756 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:47.019250 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af549-33ba-4a2e-8262-f9ecd9f2e839 service placement] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:47.040206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981ef7b-db33-4c31-9dd9-abd4c4cbc4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:47.041434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981ef7b-db33-4c31-9dd9-abd4c4cbc4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:47.042128 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981ef7b-db33-4c31-9dd9-abd4c4cbc4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:47.042684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981ef7b-db33-4c31-9dd9-abd4c4cbc4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:47.054299 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3981ef7b-db33-4c31-9dd9-abd4c4cbc4c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:47.079946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981ef7b-db33-4c31-9dd9-abd4c4cbc4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:47.082958 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981ef7b-db33-4c31-9dd9-abd4c4cbc4c8 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:47.105696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1267/2521] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:46 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:02:49.698562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:49.705633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:49.939937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634307d4-0391-4d4d-81f2-4cee9ddc4716 service placement] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:49.961146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:49.963142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:49.963750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:49.970716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:49.975553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:50.008038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:50.013897 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:50.042550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1255/2522] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:49 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:02:50.111554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df6d1-f266-4fe7-bfd9-36f49894a261 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:50.112500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df6d1-f266-4fe7-bfd9-36f49894a261 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:50.112936 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df6d1-f266-4fe7-bfd9-36f49894a261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:50.158034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-819df6d1-f266-4fe7-bfd9-36f49894a261 None None] MFA Rules not processed for user `475c710c78ce4d7680cb5f1da29863fc`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:02:50.159559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-819df6d1-f266-4fe7-bfd9-36f49894a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:50.363077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1268/2523] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:02:50 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:02:50.377409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:02:50.379809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:02:50.403574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ed7f8-e459-4887-8e18-4d6f69c40f75 service nova] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:02:50.413142 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9d61f-568e-4595-96fe-223f321fa157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:02:50.414265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d61f-568e-4595-96fe-223f321fa157 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:02:50.414882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d61f-568e-4595-96fe-223f321fa157 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:02:50.415458 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d61f-568e-4595-96fe-223f321fa157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:02:50.557978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d61f-568e-4595-96fe-223f321fa157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:02:50.561695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d61f-568e-4595-96fe-223f321fa157 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:02:50.580030 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1256/2524] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:02:50 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:03:11.338601 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c1c8-46f5-45e3-b2de-5a45d954e487 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:11.339134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c1c8-46f5-45e3-b2de-5a45d954e487 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:11.339239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c1c8-46f5-45e3-b2de-5a45d954e487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:11.362073 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-9854c1c8-46f5-45e3-b2de-5a45d954e487 None None] MFA Rules not processed for user `8b6c5ce8a6e342b492f56c29d5f8b473`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:03:11.363271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9854c1c8-46f5-45e3-b2de-5a45d954e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:11.369704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1269/2525] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:03:11 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:03:24.554589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b803a-d96b-484b-b8c3-e9bd1375ef89 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:24.555186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b803a-d96b-484b-b8c3-e9bd1375ef89 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:24.555341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b803a-d96b-484b-b8c3-e9bd1375ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:24.578100 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e04b803a-d96b-484b-b8c3-e9bd1375ef89 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:03:24.579314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e04b803a-d96b-484b-b8c3-e9bd1375ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:24.651900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1257/2526] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 15:03:24 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:03:24.703397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c1c8-46f5-45e3-b2de-5a45d954e487 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:03:24.704019 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9854c1c8-46f5-45e3-b2de-5a45d954e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:24.838884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c1c8-46f5-45e3-b2de-5a45d954e487 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:03:24.848020 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215d0a0-d780-4d83-a162-fcc34fc25a4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:03:24.849023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215d0a0-d780-4d83-a162-fcc34fc25a4c service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:24.849372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215d0a0-d780-4d83-a162-fcc34fc25a4c service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:24.849659 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215d0a0-d780-4d83-a162-fcc34fc25a4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:24.860525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215d0a0-d780-4d83-a162-fcc34fc25a4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:03:24.862650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215d0a0-d780-4d83-a162-fcc34fc25a4c service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:03:24.873810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1270/2527] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:03:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:03:25.120614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b803a-d96b-484b-b8c3-e9bd1375ef89 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:03:25.136776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b803a-d96b-484b-b8c3-e9bd1375ef89 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:03:25.147536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:03:25.147536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:25.147536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:25.147536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:25.149997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:25.172083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:03:25.174067 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:03:25.187471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1258/2528] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:03:25 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:03:36.991958 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215d0a0-d780-4d83-a162-fcc34fc25a4c service swift] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:03:37.003066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215d0a0-d780-4d83-a162-fcc34fc25a4c service swift] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:03:37.008790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6693c-8d12-4c54-ae56-e9a113c4fe52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:03:37.009695 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6693c-8d12-4c54-ae56-e9a113c4fe52 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:37.010144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6693c-8d12-4c54-ae56-e9a113c4fe52 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:37.019086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6693c-8d12-4c54-ae56-e9a113c4fe52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:37.037360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6693c-8d12-4c54-ae56-e9a113c4fe52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:03:37.038903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6693c-8d12-4c54-ae56-e9a113c4fe52 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:03:37.050499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1271/2529] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:03:36 2021] GET /identity/v3/auth/tokens => generated 3749 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:03:41.013173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:03:41.030753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf17a2c-514d-4de1-9448-d83eba77e4ee service nova] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:03:41.036818 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e797a-6358-4ffe-8708-b898816eeba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:03:41.037688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e797a-6358-4ffe-8708-b898816eeba4 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:41.037980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e797a-6358-4ffe-8708-b898816eeba4 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:41.038266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e797a-6358-4ffe-8708-b898816eeba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:41.040249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-460e797a-6358-4ffe-8708-b898816eeba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:41.053179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e797a-6358-4ffe-8708-b898816eeba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:03:41.054814 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e797a-6358-4ffe-8708-b898816eeba4 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:03:41.067491 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1259/2530] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:03:41 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:03:43.344877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a364-0781-45bd-be27-1f96b83769f5 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:43.345469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a364-0781-45bd-be27-1f96b83769f5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:43.345809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a364-0781-45bd-be27-1f96b83769f5 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:43.349074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1272/2531] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 15:03:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 15:03:43.355498 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147922-31b4-480c-bca2-493031de4a64 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:43.356411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147922-31b4-480c-bca2-493031de4a64 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:43.356411 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147922-31b4-480c-bca2-493031de4a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:43.433152 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f6147922-31b4-480c-bca2-493031de4a64 None None] MFA Rules not processed for user `baae94f89c07491a875477ede4e06b57`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:03:43.435456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f6147922-31b4-480c-bca2-493031de4a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:43.447726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1260/2532] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 15:03:43 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:03:43.460692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0a364-0781-45bd-be27-1f96b83769f5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:03:43.462634 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5af0a364-0781-45bd-be27-1f96b83769f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:43.549970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0a364-0781-45bd-be27-1f96b83769f5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:03:43.554662 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afee1f-902d-484c-b9c6-6d34cad307a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92f456ee8cf4564aaca2b16f320b49d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:03:43.555327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afee1f-902d-484c-b9c6-6d34cad307a4 service glance] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:43.555607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afee1f-902d-484c-b9c6-6d34cad307a4 service glance] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:43.555891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afee1f-902d-484c-b9c6-6d34cad307a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:43.571108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afee1f-902d-484c-b9c6-6d34cad307a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:03:43.572548 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afee1f-902d-484c-b9c6-6d34cad307a4 service glance] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:03:43.585015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1273/2533] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:03:43 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:03:43.673090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42aae7-bf70-4295-822c-b81b0de90fc8 None None] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:43.673376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42aae7-bf70-4295-822c-b81b0de90fc8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:43.673660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42aae7-bf70-4295-822c-b81b0de90fc8 None None] PATH_INFO: `/` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:43.675423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1261/2534] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 15:03:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 15:03:43.682816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f59b-0c85-461c-8d20-2b6d342c1ea4 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:43.683120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f59b-0c85-461c-8d20-2b6d342c1ea4 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:43.683502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f59b-0c85-461c-8d20-2b6d342c1ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:43.708609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c887f59b-0c85-461c-8d20-2b6d342c1ea4 None None] MFA Rules not processed for user `b7a70a0361b648d6a4233546a1d4901d`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:03:43.709776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c887f59b-0c85-461c-8d20-2b6d342c1ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:43.716318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1274/2535] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 15:03:43 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:03:43.729607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42aae7-bf70-4295-822c-b81b0de90fc8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:03:43.742212 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42aae7-bf70-4295-822c-b81b0de90fc8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:03:43.745782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee906e8-dcbe-41bd-9240-4285b51b20e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:03:43.746376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee906e8-dcbe-41bd-9240-4285b51b20e7 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:43.746703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee906e8-dcbe-41bd-9240-4285b51b20e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:43.747531 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee906e8-dcbe-41bd-9240-4285b51b20e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:43.755842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee906e8-dcbe-41bd-9240-4285b51b20e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:03:43.757268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee906e8-dcbe-41bd-9240-4285b51b20e7 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:03:43.766121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1262/2536] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:03:43 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:03:48.620185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2011ce4-3e91-40ba-8123-3a5253aaff3c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:48.621006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2011ce4-3e91-40ba-8123-3a5253aaff3c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:48.621303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2011ce4-3e91-40ba-8123-3a5253aaff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:48.644138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a2011ce4-3e91-40ba-8123-3a5253aaff3c None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:03:48.645316 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a2011ce4-3e91-40ba-8123-3a5253aaff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:03:48.652712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1275/2537] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 15:03:48 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:03:48.666386 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee906e8-dcbe-41bd-9240-4285b51b20e7 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:03:48.687592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee906e8-dcbe-41bd-9240-4285b51b20e7 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:03:48.694996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6c55-0589-42b8-8a14-7cf662a0ecd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:03:48.695618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6c55-0589-42b8-8a14-7cf662a0ecd6 service swift] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:03:48.695902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6c55-0589-42b8-8a14-7cf662a0ecd6 service swift] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:03:48.696178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6c55-0589-42b8-8a14-7cf662a0ecd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:03:48.705286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a6c55-0589-42b8-8a14-7cf662a0ecd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:03:48.706903 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a6c55-0589-42b8-8a14-7cf662a0ecd6 service swift] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:03:48.715394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1263/2538] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:03:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:04:01.228431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8a81-570e-4a2e-99c8-4016d9694844 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:01.228431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8a81-570e-4a2e-99c8-4016d9694844 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:01.228431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8a81-570e-4a2e-99c8-4016d9694844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:01.249677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-cfdd8a81-570e-4a2e-99c8-4016d9694844 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:01.250884 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-cfdd8a81-570e-4a2e-99c8-4016d9694844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:01.257698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1276/2539] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 25 15:04:01 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:01.270843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6c55-0589-42b8-8a14-7cf662a0ecd6 service swift] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:01.281441 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6c55-0589-42b8-8a14-7cf662a0ecd6 service swift] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:01.286952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804505-532f-4306-9ec3-60a4345eef93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:01.287533 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804505-532f-4306-9ec3-60a4345eef93 service swift] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:01.287816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804505-532f-4306-9ec3-60a4345eef93 service swift] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:01.288103 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804505-532f-4306-9ec3-60a4345eef93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:01.298106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87804505-532f-4306-9ec3-60a4345eef93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:01.299813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87804505-532f-4306-9ec3-60a4345eef93 service swift] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:01.308930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1264/2540] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:04:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:04:13.596745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01632-3864-49cf-a249-9d4560a44084 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:13.597836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01632-3864-49cf-a249-9d4560a44084 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:13.598349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01632-3864-49cf-a249-9d4560a44084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:13.628393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0aa01632-3864-49cf-a249-9d4560a44084 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:13.629969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0aa01632-3864-49cf-a249-9d4560a44084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:13.654216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1277/2541] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 25 15:04:13 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:13.657157 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804505-532f-4306-9ec3-60a4345eef93 service swift] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:13.669831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804505-532f-4306-9ec3-60a4345eef93 service swift] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:13.677762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec307-44b8-4a9f-848f-3d54fa300ce9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:13.679262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec307-44b8-4a9f-848f-3d54fa300ce9 service swift] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:13.680158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec307-44b8-4a9f-848f-3d54fa300ce9 service swift] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:13.681200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec307-44b8-4a9f-848f-3d54fa300ce9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:13.700378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bec307-44b8-4a9f-848f-3d54fa300ce9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:13.704615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bec307-44b8-4a9f-848f-3d54fa300ce9 service swift] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:13.729984 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1265/2542] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:04:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:04:16.331871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01632-3864-49cf-a249-9d4560a44084 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:16.335197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0aa01632-3864-49cf-a249-9d4560a44084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:16.433000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01632-3864-49cf-a249-9d4560a44084 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:16.438315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:16.439172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:16.439467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:16.439745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] PATH_INFO: `/v3/users/a1cbfc1dd41544d39c935a6a0dd4be2b` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:16.440997 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1cbfc1dd41544d39c935a6a0dd4be2b)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:16.442967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:16.498467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1cbfc1dd41544d39c935a6a0dd4be2b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:16.507388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1cbfc1dd41544d39c935a6a0dd4be2b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:16.508048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1cbfc1dd41544d39c935a6a0dd4be2b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:16.508649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1cbfc1dd41544d39c935a6a0dd4be2b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:16.521600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1cbfc1dd41544d39c935a6a0dd4be2b'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:16.535185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1278/2543] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:04:16 2021] DELETE /identity/v3/users/a1cbfc1dd41544d39c935a6a0dd4be2b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:04:16.895300 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec307-44b8-4a9f-848f-3d54fa300ce9 service swift] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:16.906579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec307-44b8-4a9f-848f-3d54fa300ce9 service swift] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:16.981199 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:16.981952 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:16.982235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:16.982810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] PATH_INFO: `/v3/projects/3e67a2e47e9b4189b5270beff7f12aaa` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:16.984045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e67a2e47e9b4189b5270beff7f12aaa)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:16.986001 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:17.038500 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e67a2e47e9b4189b5270beff7f12aaa', 'request_id': 'req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.052978 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e67a2e47e9b4189b5270beff7f12aaa', 'request_id': 'req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.061392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e67a2e47e9b4189b5270beff7f12aaa', 'request_id': 'req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.079480 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] The token cache is being invalidate because project 3e67a2e47e9b4189b5270beff7f12aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:04:17.079953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.080657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.082195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1266/2544] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:04:16 2021] DELETE /identity/v3/projects/3e67a2e47e9b4189b5270beff7f12aaa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:04:17.087223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:17.088678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:17.102725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a65f9-c506-4c56-afbc-1ee22aed3148 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:17.179319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:17.180141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:17.180434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:17.180737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] PATH_INFO: `/v3/users/41041e59a6fb422badda5f58d7c615c3` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:17.181948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41041e59a6fb422badda5f58d7c615c3)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:17.183909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:17.240917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41041e59a6fb422badda5f58d7c615c3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.248582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41041e59a6fb422badda5f58d7c615c3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.249409 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41041e59a6fb422badda5f58d7c615c3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.250117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41041e59a6fb422badda5f58d7c615c3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.263976 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ab140b2a-0339-4066-a222-9468850da30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41041e59a6fb422badda5f58d7c615c3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.277059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1279/2545] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:04:17 2021] DELETE /identity/v3/users/41041e59a6fb422badda5f58d7c615c3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:04:17.502784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:17.504161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:17.517254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d93ac-5cb1-4973-a6f0-67bc3f9f735c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:17.579880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:17.580664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:17.580951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:17.581234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] PATH_INFO: `/v3/projects/df4c91d3ef8547ec8f439803e0635458` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:17.582340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4c91d3ef8547ec8f439803e0635458)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:17.584260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:17.632607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4c91d3ef8547ec8f439803e0635458', 'request_id': 'req-912c639a-8002-4d70-a4f5-f1850f3cfa32'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.638545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4c91d3ef8547ec8f439803e0635458', 'request_id': 'req-912c639a-8002-4d70-a4f5-f1850f3cfa32'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.646499 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4c91d3ef8547ec8f439803e0635458', 'request_id': 'req-912c639a-8002-4d70-a4f5-f1850f3cfa32'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.666200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] The token cache is being invalidate because project df4c91d3ef8547ec8f439803e0635458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:04:17.666551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.667745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-912c639a-8002-4d70-a4f5-f1850f3cfa32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:17.669703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1267/2546] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:04:17 2021] DELETE /identity/v3/projects/df4c91d3ef8547ec8f439803e0635458 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:04:20.707870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bfa11-a977-4a75-abd2-982c33e54237 None None] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:20.708620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bfa11-a977-4a75-abd2-982c33e54237 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:20.708919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bfa11-a977-4a75-abd2-982c33e54237 None None] PATH_INFO: `/` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:20.710908 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1280/2547] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 25 15:04:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 15:04:20.717111 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb1093-5a87-4bda-bf67-8347c40e08a6 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:20.717711 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb1093-5a87-4bda-bf67-8347c40e08a6 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:20.717711 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb1093-5a87-4bda-bf67-8347c40e08a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:20.741012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f5eb1093-5a87-4bda-bf67-8347c40e08a6 None None] MFA Rules not processed for user `b7a70a0361b648d6a4233546a1d4901d`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:20.742195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f5eb1093-5a87-4bda-bf67-8347c40e08a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:20.807957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1268/2548] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 25 15:04:20 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:04:20.833929 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bfa11-a977-4a75-abd2-982c33e54237 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:20.837122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-9c0bfa11-a977-4a75-abd2-982c33e54237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:20.859495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bfa11-a977-4a75-abd2-982c33e54237 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:20.866394 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:20.867066 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:20.868419 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:20.869057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:20.882729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:20.884381 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:20.901376 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1281/2549] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:04:20 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:04:35.570355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb1093-5a87-4bda-bf67-8347c40e08a6 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:35.571827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f5eb1093-5a87-4bda-bf67-8347c40e08a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:35.582769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb1093-5a87-4bda-bf67-8347c40e08a6 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:35.586435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:35.587026 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:35.587307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:35.587580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:35.589225 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:35.660788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:35.662258 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:35.671965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1269/2550] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:04:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:04:41.123979 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:41.125508 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:41.140350 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a580-05f3-40f9-8107-e4ad93afe890 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:41.144648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:41.145463 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:41.145733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:41.146011 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] PATH_INFO: `/v3/users/aa6c8c2103534ca28f981d39cecb2c70` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:41.147122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6c8c2103534ca28f981d39cecb2c70)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:41.149071 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:41.203568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6c8c2103534ca28f981d39cecb2c70'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.210710 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6c8c2103534ca28f981d39cecb2c70'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.211387 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6c8c2103534ca28f981d39cecb2c70'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.211999 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6c8c2103534ca28f981d39cecb2c70'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.225043 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-95ca0fc4-3f7b-444f-9ec7-bff9f670bd20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6c8c2103534ca28f981d39cecb2c70'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.238711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1282/2551] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:04:41 2021] DELETE /identity/v3/users/aa6c8c2103534ca28f981d39cecb2c70 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:41.467839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:41.477650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d63e-2b43-49d4-89c8-358bd1728b23 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:41.544540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:41.545331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:41.545616 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:41.545895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] PATH_INFO: `/v3/projects/f775951e4c0e43ab8e9a421071c6c3d4` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:41.547086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f775951e4c0e43ab8e9a421071c6c3d4)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:41.548879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:41.598097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f775951e4c0e43ab8e9a421071c6c3d4', 'request_id': 'req-68883508-1a43-45c4-8177-eb854cb4dcd3'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.603486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f775951e4c0e43ab8e9a421071c6c3d4', 'request_id': 'req-68883508-1a43-45c4-8177-eb854cb4dcd3'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.611477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f775951e4c0e43ab8e9a421071c6c3d4', 'request_id': 'req-68883508-1a43-45c4-8177-eb854cb4dcd3'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.627988 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] The token cache is being invalidate because project f775951e4c0e43ab8e9a421071c6c3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:04:41.628277 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.629014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-68883508-1a43-45c4-8177-eb854cb4dcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:41.630723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1270/2552] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:04:41 2021] DELETE /identity/v3/projects/f775951e4c0e43ab8e9a421071c6c3d4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:41.636881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b016b-ece1-4a58-912e-71213296bb2c None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:41.637177 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b016b-ece1-4a58-912e-71213296bb2c None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:41.637463 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b016b-ece1-4a58-912e-71213296bb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:41.660305 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-fc1b016b-ece1-4a58-912e-71213296bb2c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:41.661504 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fc1b016b-ece1-4a58-912e-71213296bb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:41.726191 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1283/2553] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:41.734999 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079adef5-f4bd-4ba5-ad65-f7e87d57242c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:41.735292 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079adef5-f4bd-4ba5-ad65-f7e87d57242c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:41.735601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079adef5-f4bd-4ba5-ad65-f7e87d57242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:41.757593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-079adef5-f4bd-4ba5-ad65-f7e87d57242c None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:41.758829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-079adef5-f4bd-4ba5-ad65-f7e87d57242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:41.766105 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1271/2554] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:41.770184 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b016b-ece1-4a58-912e-71213296bb2c None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:41.779981 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b016b-ece1-4a58-912e-71213296bb2c None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:41.784388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:41.784975 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:41.785277 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:41.785560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:41.786296 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:04:41.786724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:41.788696 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:41.803661 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1284/2555] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:04:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:04:41.808433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079adef5-f4bd-4ba5-ad65-f7e87d57242c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:41.817620 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079adef5-f4bd-4ba5-ad65-f7e87d57242c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:41.822167 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0210-3242-4187-bf65-3b135f3d6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:41.822859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0210-3242-4187-bf65-3b135f3d6787 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:41.823217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0210-3242-4187-bf65-3b135f3d6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:41.823572 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0210-3242-4187-bf65-3b135f3d6787 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:41.824285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f0210-3242-4187-bf65-3b135f3d6787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:41.826274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f0210-3242-4187-bf65-3b135f3d6787 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:41.865203 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1272/2556] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:04:41 2021] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:04:41.869482 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:41.879304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb36a2-5585-4410-ac82-3cfd5387f1cb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:41.943583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cac2fc-6578-408b-9f7c-d57d266dfc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:41.944182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac2fc-6578-408b-9f7c-d57d266dfc24 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:41.944472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac2fc-6578-408b-9f7c-d57d266dfc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:41.944757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac2fc-6578-408b-9f7c-d57d266dfc24 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:41.945393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cac2fc-6578-408b-9f7c-d57d266dfc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:41.947333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cac2fc-6578-408b-9f7c-d57d266dfc24 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:41.966320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1285/2557] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:04:41 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:04:41.970430 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0210-3242-4187-bf65-3b135f3d6787 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:41.981124 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0210-3242-4187-bf65-3b135f3d6787 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:41.985702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b5da-20c6-479b-a925-9f2eae6479bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:41.986286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b5da-20c6-479b-a925-9f2eae6479bd admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:41.986597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b5da-20c6-479b-a925-9f2eae6479bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:41.986874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b5da-20c6-479b-a925-9f2eae6479bd admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:41.987592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b5da-20c6-479b-a925-9f2eae6479bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:41.989161 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b5da-20c6-479b-a925-9f2eae6479bd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:41.999702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1273/2558] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:04:42.003753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cac2fc-6578-408b-9f7c-d57d266dfc24 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:42.013862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cac2fc-6578-408b-9f7c-d57d266dfc24 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:42.018313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acbe47-751b-4418-80dd-c6aa47567978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:42.019014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbe47-751b-4418-80dd-c6aa47567978 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:42.019333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbe47-751b-4418-80dd-c6aa47567978 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:42.019663 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbe47-751b-4418-80dd-c6aa47567978 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:42.020428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acbe47-751b-4418-80dd-c6aa47567978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:42.022015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acbe47-751b-4418-80dd-c6aa47567978 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:42.032680 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1286/2559] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:04:42.036872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b5da-20c6-479b-a925-9f2eae6479bd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:42.046577 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b5da-20c6-479b-a925-9f2eae6479bd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:42.051250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:42.052060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:42.052342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:42.052621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] PATH_INFO: `/v3/projects/267c5ef1ffc245f896337fd99e6250aa/users/77f79bd54a6e451b8ab1b27550734201/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:42.072216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267c5ef1ffc245f896337fd99e6250aa, user_id=77f79bd54a6e451b8ab1b27550734201, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:42.075354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:42.091377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1274/2560] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:04:42 2021] PUT /identity/v3/projects/267c5ef1ffc245f896337fd99e6250aa/users/77f79bd54a6e451b8ab1b27550734201/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:04:42.101488 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9dd0a-2329-4ca5-9af0-c8fcf8839752 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:42.101780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9dd0a-2329-4ca5-9af0-c8fcf8839752 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:42.102061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9dd0a-2329-4ca5-9af0-c8fcf8839752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:42.138371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b0b9dd0a-2329-4ca5-9af0-c8fcf8839752 None None] MFA Rules not processed for user `77f79bd54a6e451b8ab1b27550734201`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:42.139554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b0b9dd0a-2329-4ca5-9af0-c8fcf8839752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:42.212157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1287/2561] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:42 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:42.222911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:42.224536 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:42.302823 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788aded-dcd9-406a-91f8-480b9b350996 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:42.310752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4855b-776d-4d6d-9366-27189af0a7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:42.310752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4855b-776d-4d6d-9366-27189af0a7ed service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:42.310752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4855b-776d-4d6d-9366-27189af0a7ed service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:42.310752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4855b-776d-4d6d-9366-27189af0a7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:42.321311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4855b-776d-4d6d-9366-27189af0a7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:42.322958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4855b-776d-4d6d-9366-27189af0a7ed service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:42.334016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1275/2562] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:04:42 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:04:51.247735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9dd0a-2329-4ca5-9af0-c8fcf8839752 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:51.315671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9dd0a-2329-4ca5-9af0-c8fcf8839752 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:51.319993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:51.320797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:51.321088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:51.321373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] PATH_INFO: `/v3/users/77f79bd54a6e451b8ab1b27550734201` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:51.322500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f79bd54a6e451b8ab1b27550734201)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:51.324430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:51.372178 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f79bd54a6e451b8ab1b27550734201'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:51.378990 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f79bd54a6e451b8ab1b27550734201'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:51.379597 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f79bd54a6e451b8ab1b27550734201'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:51.380187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f79bd54a6e451b8ab1b27550734201'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:51.392037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f79bd54a6e451b8ab1b27550734201'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:51.405356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1288/2563] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:04:51 2021] DELETE /identity/v3/users/77f79bd54a6e451b8ab1b27550734201 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:51.409887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f809b-1f17-4353-b28a-2dcb07b17654 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:51.410427 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f809b-1f17-4353-b28a-2dcb07b17654 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:51.410530 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f809b-1f17-4353-b28a-2dcb07b17654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:51.436082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-b02f809b-1f17-4353-b28a-2dcb07b17654 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:51.439184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b02f809b-1f17-4353-b28a-2dcb07b17654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:51.504496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1276/2564] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:51.514683 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:51.515996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:51.578418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002b53-98cc-436e-851d-f896e61e997a admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:51.581912 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e8e61-3fa6-4389-85f2-69df429b550e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:51.582517 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8e61-3fa6-4389-85f2-69df429b550e service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:51.582803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8e61-3fa6-4389-85f2-69df429b550e service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:51.583087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8e61-3fa6-4389-85f2-69df429b550e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:51.594152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e8e61-3fa6-4389-85f2-69df429b550e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:51.595665 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e8e61-3fa6-4389-85f2-69df429b550e service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:51.604918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1289/2565] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:04:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:04:51.986827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f809b-1f17-4353-b28a-2dcb07b17654 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:51.988392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b02f809b-1f17-4353-b28a-2dcb07b17654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:52.000784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f809b-1f17-4353-b28a-2dcb07b17654 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.005130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.005918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.006202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.006514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] PATH_INFO: `/v3/projects/267c5ef1ffc245f896337fd99e6250aa` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.007876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=267c5ef1ffc245f896337fd99e6250aa)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.009835 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.061729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267c5ef1ffc245f896337fd99e6250aa', 'request_id': 'req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:52.066751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267c5ef1ffc245f896337fd99e6250aa', 'request_id': 'req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:52.075013 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267c5ef1ffc245f896337fd99e6250aa', 'request_id': 'req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:52.091307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] The token cache is being invalidate because project 267c5ef1ffc245f896337fd99e6250aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:04:52.091751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:52.092448 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-cbfcbf87-46d9-4653-9f6b-71ef761ca26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:52.093936 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1277/2566] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:04:51 2021] DELETE /identity/v3/projects/267c5ef1ffc245f896337fd99e6250aa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:04:52.099814 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f81d81-2158-49b6-9a61-fdbf50439f14 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.100109 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f81d81-2158-49b6-9a61-fdbf50439f14 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.100389 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f81d81-2158-49b6-9a61-fdbf50439f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.125407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-50f81d81-2158-49b6-9a61-fdbf50439f14 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:52.126603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-50f81d81-2158-49b6-9a61-fdbf50439f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:52.192856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1290/2567] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:52.201140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1508c-9d2e-4c68-989f-50eed802973a None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.201424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1508c-9d2e-4c68-989f-50eed802973a None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.201703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1508c-9d2e-4c68-989f-50eed802973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.225673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-56e1508c-9d2e-4c68-989f-50eed802973a None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:52.226883 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-56e1508c-9d2e-4c68-989f-50eed802973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:52.234333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1278/2568] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:52.238564 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f81d81-2158-49b6-9a61-fdbf50439f14 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.251595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f81d81-2158-49b6-9a61-fdbf50439f14 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.256850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.257762 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.258180 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.258653 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.259544 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:04:52.259879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.261521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.275202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1291/2569] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:04:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:04:52.280453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1508c-9d2e-4c68-989f-50eed802973a None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.290632 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1508c-9d2e-4c68-989f-50eed802973a None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.295137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5064fd-a86c-450a-b6e4-896bc19afea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.295728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5064fd-a86c-450a-b6e4-896bc19afea0 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.296012 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5064fd-a86c-450a-b6e4-896bc19afea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.296296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5064fd-a86c-450a-b6e4-896bc19afea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.296950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5064fd-a86c-450a-b6e4-896bc19afea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.298895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5064fd-a86c-450a-b6e4-896bc19afea0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.330609 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1279/2570] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:04:52 2021] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:04:52.332402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.343149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ded2-d810-4e19-a70c-9a909bd58ba6 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.409082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099173f8-3201-46e7-870b-79cbb435c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.409685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099173f8-3201-46e7-870b-79cbb435c54e admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.409972 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099173f8-3201-46e7-870b-79cbb435c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.410252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099173f8-3201-46e7-870b-79cbb435c54e admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.410917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099173f8-3201-46e7-870b-79cbb435c54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.412960 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099173f8-3201-46e7-870b-79cbb435c54e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.434592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1292/2571] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:04:52 2021] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:04:52.438808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5064fd-a86c-450a-b6e4-896bc19afea0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.448595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5064fd-a86c-450a-b6e4-896bc19afea0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.453746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d246ef-1eeb-4663-a42d-034eb5fcdb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.454322 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d246ef-1eeb-4663-a42d-034eb5fcdb5c admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.454636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d246ef-1eeb-4663-a42d-034eb5fcdb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.454915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d246ef-1eeb-4663-a42d-034eb5fcdb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.455601 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d246ef-1eeb-4663-a42d-034eb5fcdb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.457184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d246ef-1eeb-4663-a42d-034eb5fcdb5c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.467049 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1280/2572] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:04:52.470956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099173f8-3201-46e7-870b-79cbb435c54e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.480314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099173f8-3201-46e7-870b-79cbb435c54e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.485397 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8c960-c3cf-4447-be4f-302b60997821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.485979 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8c960-c3cf-4447-be4f-302b60997821 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.486267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8c960-c3cf-4447-be4f-302b60997821 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.486606 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8c960-c3cf-4447-be4f-302b60997821 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.487292 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8c960-c3cf-4447-be4f-302b60997821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.488865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8c960-c3cf-4447-be4f-302b60997821 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.499400 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1293/2573] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:04:52.503438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d246ef-1eeb-4663-a42d-034eb5fcdb5c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.512840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d246ef-1eeb-4663-a42d-034eb5fcdb5c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.517158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231cf84-f04c-44e6-aae7-7549d5b96b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.517955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231cf84-f04c-44e6-aae7-7549d5b96b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.518241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231cf84-f04c-44e6-aae7-7549d5b96b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.518553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231cf84-f04c-44e6-aae7-7549d5b96b44 admin admin] PATH_INFO: `/v3/projects/4a06449683fa431b90e0cfc34b230db3/users/0ac5f0a3535445e297ffe1f5a9843f60/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.537094 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231cf84-f04c-44e6-aae7-7549d5b96b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a06449683fa431b90e0cfc34b230db3, user_id=0ac5f0a3535445e297ffe1f5a9843f60, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.539726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231cf84-f04c-44e6-aae7-7549d5b96b44 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.552172 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1281/2574] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:04:52 2021] PUT /identity/v3/projects/4a06449683fa431b90e0cfc34b230db3/users/0ac5f0a3535445e297ffe1f5a9843f60/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:52.564554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497533e-b46e-46df-8694-c5d5c2bf44fe None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.564847 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497533e-b46e-46df-8694-c5d5c2bf44fe None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.565125 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497533e-b46e-46df-8694-c5d5c2bf44fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.599384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f497533e-b46e-46df-8694-c5d5c2bf44fe None None] MFA Rules not processed for user `0ac5f0a3535445e297ffe1f5a9843f60`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:52.600521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f497533e-b46e-46df-8694-c5d5c2bf44fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:52.671137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1294/2575] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:52 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:52.675558 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231cf84-f04c-44e6-aae7-7549d5b96b44 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.744401 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231cf84-f04c-44e6-aae7-7549d5b96b44 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.749509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed4a9-418a-424c-ae69-064f5e491c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.750099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed4a9-418a-424c-ae69-064f5e491c42 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.750388 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed4a9-418a-424c-ae69-064f5e491c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.750703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed4a9-418a-424c-ae69-064f5e491c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.751387 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ed4a9-418a-424c-ae69-064f5e491c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.753266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ed4a9-418a-424c-ae69-064f5e491c42 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.778953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1282/2576] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:04:52 2021] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:04:52.784228 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497533e-b46e-46df-8694-c5d5c2bf44fe None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.794953 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497533e-b46e-46df-8694-c5d5c2bf44fe None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.862209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34c6cd-cac3-433a-a1ab-d2749e3dc1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.862861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c6cd-cac3-433a-a1ab-d2749e3dc1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.863145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c6cd-cac3-433a-a1ab-d2749e3dc1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.863420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c6cd-cac3-433a-a1ab-d2749e3dc1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.864042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34c6cd-cac3-433a-a1ab-d2749e3dc1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.865931 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34c6cd-cac3-433a-a1ab-d2749e3dc1e8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.888653 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1295/2577] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:04:52 2021] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:04:52.893137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed4a9-418a-424c-ae69-064f5e491c42 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.904117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed4a9-418a-424c-ae69-064f5e491c42 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.908594 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66ae6c-957e-4334-be8d-b2485a54d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.909229 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ae6c-957e-4334-be8d-b2485a54d9cc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.909518 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ae6c-957e-4334-be8d-b2485a54d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.909801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ae6c-957e-4334-be8d-b2485a54d9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.910529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66ae6c-957e-4334-be8d-b2485a54d9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.912121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66ae6c-957e-4334-be8d-b2485a54d9cc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.923538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1283/2578] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:04:52.927750 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34c6cd-cac3-433a-a1ab-d2749e3dc1e8 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.937412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34c6cd-cac3-433a-a1ab-d2749e3dc1e8 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:52.941735 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e78c4-a947-41fb-a78c-b6ff1a7c228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:52.942591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e78c4-a947-41fb-a78c-b6ff1a7c228d admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:52.942876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e78c4-a947-41fb-a78c-b6ff1a7c228d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:52.943154 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e78c4-a947-41fb-a78c-b6ff1a7c228d admin admin] PATH_INFO: `/v3/projects/44afc372d2a54260ab7c91ab22b78f78/users/456cbbc14da14f43ae92307c4b57cf17/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:52.965476 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e78c4-a947-41fb-a78c-b6ff1a7c228d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44afc372d2a54260ab7c91ab22b78f78, user_id=456cbbc14da14f43ae92307c4b57cf17, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:52.968044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e78c4-a947-41fb-a78c-b6ff1a7c228d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:52.983793 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1296/2579] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:04:52 2021] PUT /identity/v3/projects/44afc372d2a54260ab7c91ab22b78f78/users/456cbbc14da14f43ae92307c4b57cf17/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:52.987908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66ae6c-957e-4334-be8d-b2485a54d9cc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:52.997959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66ae6c-957e-4334-be8d-b2485a54d9cc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:53.071021 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173a560-deb5-4b0f-89dd-f80b9c073517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:53.071625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a560-deb5-4b0f-89dd-f80b9c073517 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:53.071906 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a560-deb5-4b0f-89dd-f80b9c073517 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:53.072182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a560-deb5-4b0f-89dd-f80b9c073517 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:53.072871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173a560-deb5-4b0f-89dd-f80b9c073517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:53.074569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173a560-deb5-4b0f-89dd-f80b9c073517 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:53.085207 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1284/2580] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:52 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:04:53.089313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e78c4-a947-41fb-a78c-b6ff1a7c228d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:53.099620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e78c4-a947-41fb-a78c-b6ff1a7c228d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:53.103905 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:53.104705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:53.104988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:53.105264 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] PATH_INFO: `/v3/projects/44afc372d2a54260ab7c91ab22b78f78/users/456cbbc14da14f43ae92307c4b57cf17/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:53.108061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44afc372d2a54260ab7c91ab22b78f78, user_id=456cbbc14da14f43ae92307c4b57cf17, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:53.110823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:53.120861 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1297/2581] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:04:53 2021] PUT /identity/v3/projects/44afc372d2a54260ab7c91ab22b78f78/users/456cbbc14da14f43ae92307c4b57cf17/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:53.130994 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80811-3f1e-4945-9db4-8a8cea7fecbe None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:53.131311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80811-3f1e-4945-9db4-8a8cea7fecbe None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:53.131613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80811-3f1e-4945-9db4-8a8cea7fecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:53.167071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c1c80811-3f1e-4945-9db4-8a8cea7fecbe None None] MFA Rules not processed for user `456cbbc14da14f43ae92307c4b57cf17`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:53.168870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c1c80811-3f1e-4945-9db4-8a8cea7fecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:53.248174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1285/2582] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:53 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:04:53.258129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:53.259794 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:53.328246 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e4142-8f3a-42f7-b309-78b937909478 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:53.331878 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa13402-09fc-40b4-8f58-ee3736af1ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:53.332467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa13402-09fc-40b4-8f58-ee3736af1ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:53.332757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa13402-09fc-40b4-8f58-ee3736af1ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:53.333038 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa13402-09fc-40b4-8f58-ee3736af1ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:53.342817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa13402-09fc-40b4-8f58-ee3736af1ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:53.344262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa13402-09fc-40b4-8f58-ee3736af1ed6 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:53.353909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1298/2583] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:04:53 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:04:53.456563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c80811-3f1e-4945-9db4-8a8cea7fecbe None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:53.466954 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c80811-3f1e-4945-9db4-8a8cea7fecbe None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:53.470745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfa4d5-faf6-4038-8f1e-b8c196ba26f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:53.471336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa4d5-faf6-4038-8f1e-b8c196ba26f3 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:53.471624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa4d5-faf6-4038-8f1e-b8c196ba26f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:53.471911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa4d5-faf6-4038-8f1e-b8c196ba26f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:53.537020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa4d5-faf6-4038-8f1e-b8c196ba26f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:53.538534 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa4d5-faf6-4038-8f1e-b8c196ba26f3 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:53.548586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1286/2584] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:04:53 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:04:56.429074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa13402-09fc-40b4-8f58-ee3736af1ed6 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:56.504149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa13402-09fc-40b4-8f58-ee3736af1ed6 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:56.508499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:56.509303 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:56.509592 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:56.509871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] PATH_INFO: `/v3/users/0ac5f0a3535445e297ffe1f5a9843f60` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:56.511005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac5f0a3535445e297ffe1f5a9843f60)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:56.513465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:56.561948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac5f0a3535445e297ffe1f5a9843f60'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:56.569416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac5f0a3535445e297ffe1f5a9843f60'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:56.570174 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac5f0a3535445e297ffe1f5a9843f60'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:56.570894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac5f0a3535445e297ffe1f5a9843f60'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:56.583946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac5f0a3535445e297ffe1f5a9843f60'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:56.597069 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1299/2585] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:04:56 2021] DELETE /identity/v3/users/0ac5f0a3535445e297ffe1f5a9843f60 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:56.601390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812472f-7fcb-45b7-b314-bd643f5bf40f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:56.602279 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812472f-7fcb-45b7-b314-bd643f5bf40f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:56.602614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812472f-7fcb-45b7-b314-bd643f5bf40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:56.625659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-f812472f-7fcb-45b7-b314-bd643f5bf40f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:56.626857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f812472f-7fcb-45b7-b314-bd643f5bf40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:56.695405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1287/2586] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:56.706988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:56.707882 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:56.774603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc45f8-4dff-44a9-8791-2e7712b49129 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:56.778036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab3b7a-3c68-42f3-af21-9815429e1b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:56.778702 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3b7a-3c68-42f3-af21-9815429e1b17 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:56.778987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3b7a-3c68-42f3-af21-9815429e1b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:56.779263 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3b7a-3c68-42f3-af21-9815429e1b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:56.789525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab3b7a-3c68-42f3-af21-9815429e1b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:56.791042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab3b7a-3c68-42f3-af21-9815429e1b17 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:56.800954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1300/2587] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:04:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:04:57.242762 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812472f-7fcb-45b7-b314-bd643f5bf40f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:57.244102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f812472f-7fcb-45b7-b314-bd643f5bf40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:57.255997 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812472f-7fcb-45b7-b314-bd643f5bf40f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:57.260360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:57.261127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:57.261409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:57.261687 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] PATH_INFO: `/v3/projects/4a06449683fa431b90e0cfc34b230db3` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:57.262813 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a06449683fa431b90e0cfc34b230db3)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:57.264731 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:57.315439 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a06449683fa431b90e0cfc34b230db3', 'request_id': 'req-e6721728-ea52-46d5-ba38-52591e47c908'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.320331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a06449683fa431b90e0cfc34b230db3', 'request_id': 'req-e6721728-ea52-46d5-ba38-52591e47c908'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.327455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a06449683fa431b90e0cfc34b230db3', 'request_id': 'req-e6721728-ea52-46d5-ba38-52591e47c908'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.344504 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] The token cache is being invalidate because project 4a06449683fa431b90e0cfc34b230db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:04:57.344716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.345475 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.347033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1288/2588] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:04:57 2021] DELETE /identity/v3/projects/4a06449683fa431b90e0cfc34b230db3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:57.351081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab3b7a-3c68-42f3-af21-9815429e1b17 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:57.361529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab3b7a-3c68-42f3-af21-9815429e1b17 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:57.423955 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:57.424764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:57.425055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:57.425337 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] PATH_INFO: `/v3/users/456cbbc14da14f43ae92307c4b57cf17` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:57.426499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456cbbc14da14f43ae92307c4b57cf17)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:57.428425 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:57.479772 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456cbbc14da14f43ae92307c4b57cf17'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.494594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456cbbc14da14f43ae92307c4b57cf17'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.495871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456cbbc14da14f43ae92307c4b57cf17'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.496636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456cbbc14da14f43ae92307c4b57cf17'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.510041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-0e4617bf-c8f0-46f8-b42c-be7382354e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456cbbc14da14f43ae92307c4b57cf17'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:57.523506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1301/2589] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:04:57 2021] DELETE /identity/v3/users/456cbbc14da14f43ae92307c4b57cf17 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:58.009738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.011767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:58.030284 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721728-ea52-46d5-ba38-52591e47c908 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:58.109289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:58.110099 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.110385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.110700 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] PATH_INFO: `/v3/projects/44afc372d2a54260ab7c91ab22b78f78` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.112304 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44afc372d2a54260ab7c91ab22b78f78)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:58.113840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:58.189905 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44afc372d2a54260ab7c91ab22b78f78', 'request_id': 'req-447ecc1c-3336-4183-a927-078dbfa43238'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:58.195288 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44afc372d2a54260ab7c91ab22b78f78', 'request_id': 'req-447ecc1c-3336-4183-a927-078dbfa43238'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:58.204965 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44afc372d2a54260ab7c91ab22b78f78', 'request_id': 'req-447ecc1c-3336-4183-a927-078dbfa43238'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:58.236832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] The token cache is being invalidate because project 44afc372d2a54260ab7c91ab22b78f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:04:58.237336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:58.238371 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-447ecc1c-3336-4183-a927-078dbfa43238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:04:58.241236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1289/2590] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:04:58 2021] DELETE /identity/v3/projects/44afc372d2a54260ab7c91ab22b78f78 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:58.248676 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88d5-f79e-4af0-b922-28fae4211cad None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.248967 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88d5-f79e-4af0-b922-28fae4211cad None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.249247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88d5-f79e-4af0-b922-28fae4211cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.274045 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-6bae88d5-f79e-4af0-b922-28fae4211cad None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:58.275247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6bae88d5-f79e-4af0-b922-28fae4211cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:58.343386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1302/2591] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:58.353066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525cf5-d38f-43d0-bb98-2a2a7b47f9a1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.353358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525cf5-d38f-43d0-bb98-2a2a7b47f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.353643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525cf5-d38f-43d0-bb98-2a2a7b47f9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.377214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-87525cf5-d38f-43d0-bb98-2a2a7b47f9a1 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:58.378372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-87525cf5-d38f-43d0-bb98-2a2a7b47f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:58.385783 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1290/2592] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:58.390876 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae88d5-f79e-4af0-b922-28fae4211cad None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.400666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae88d5-f79e-4af0-b922-28fae4211cad None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:58.405210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:58.405812 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.406098 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.406378 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.407104 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:04:58.407434 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:58.409044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:58.423485 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1303/2593] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:04:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:04:58.427651 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87525cf5-d38f-43d0-bb98-2a2a7b47f9a1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.437173 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87525cf5-d38f-43d0-bb98-2a2a7b47f9a1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:58.441587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f402ff5-12a8-4056-90ae-47eda1ef262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:58.442231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402ff5-12a8-4056-90ae-47eda1ef262a admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.442553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402ff5-12a8-4056-90ae-47eda1ef262a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.442834 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402ff5-12a8-4056-90ae-47eda1ef262a admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.443480 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f402ff5-12a8-4056-90ae-47eda1ef262a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:58.445349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f402ff5-12a8-4056-90ae-47eda1ef262a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:58.472065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1291/2594] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:04:58 2021] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:04:58.476204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.486817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01e40f-830e-40c2-a93c-a63a9dbf6159 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:58.549643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925243b-da7c-477e-9b1b-c51117b9e6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:58.550244 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925243b-da7c-477e-9b1b-c51117b9e6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.550565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925243b-da7c-477e-9b1b-c51117b9e6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.550850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925243b-da7c-477e-9b1b-c51117b9e6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.551481 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925243b-da7c-477e-9b1b-c51117b9e6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:58.553386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925243b-da7c-477e-9b1b-c51117b9e6f2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:58.571901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1304/2595] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:04:58 2021] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:04:58.576022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f402ff5-12a8-4056-90ae-47eda1ef262a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.585784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f402ff5-12a8-4056-90ae-47eda1ef262a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:58.590047 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a756d-0da0-458b-955d-497f28c97903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:58.590707 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a756d-0da0-458b-955d-497f28c97903 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.590963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a756d-0da0-458b-955d-497f28c97903 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.591243 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a756d-0da0-458b-955d-497f28c97903 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.591935 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a756d-0da0-458b-955d-497f28c97903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:58.593495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a756d-0da0-458b-955d-497f28c97903 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:58.603440 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1292/2596] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:04:58.608168 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925243b-da7c-477e-9b1b-c51117b9e6f2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.618322 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925243b-da7c-477e-9b1b-c51117b9e6f2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:58.623407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7bed7-0eb1-4a1a-9b15-3bfbb8bda3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:58.624000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7bed7-0eb1-4a1a-9b15-3bfbb8bda3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.624282 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7bed7-0eb1-4a1a-9b15-3bfbb8bda3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.624557 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7bed7-0eb1-4a1a-9b15-3bfbb8bda3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.625241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7bed7-0eb1-4a1a-9b15-3bfbb8bda3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:58.626855 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7bed7-0eb1-4a1a-9b15-3bfbb8bda3b4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:58.637354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1305/2597] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:04:58.641657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a756d-0da0-458b-955d-497f28c97903 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.651636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a756d-0da0-458b-955d-497f28c97903 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:58.656215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033693-0718-4409-b9dc-2e19b2c83099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:58.657078 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033693-0718-4409-b9dc-2e19b2c83099 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.657323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033693-0718-4409-b9dc-2e19b2c83099 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.657605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033693-0718-4409-b9dc-2e19b2c83099 admin admin] PATH_INFO: `/v3/projects/c24603af44734d44900fdeed2eecb639/users/3dd25ec458814507bf2364828f55e342/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.680197 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02033693-0718-4409-b9dc-2e19b2c83099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24603af44734d44900fdeed2eecb639, user_id=3dd25ec458814507bf2364828f55e342, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:58.682862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02033693-0718-4409-b9dc-2e19b2c83099 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:58.698459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1293/2598] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:04:58 2021] PUT /identity/v3/projects/c24603af44734d44900fdeed2eecb639/users/3dd25ec458814507bf2364828f55e342/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:58.709062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a59ef-06b4-418d-8bd3-9cac8593a495 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.709480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a59ef-06b4-418d-8bd3-9cac8593a495 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.709835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a59ef-06b4-418d-8bd3-9cac8593a495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.751033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-683a59ef-06b4-418d-8bd3-9cac8593a495 None None] MFA Rules not processed for user `3dd25ec458814507bf2364828f55e342`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:58.752217 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-683a59ef-06b4-418d-8bd3-9cac8593a495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:58.837468 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1306/2599] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:58 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:58.843354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033693-0718-4409-b9dc-2e19b2c83099 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.924132 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033693-0718-4409-b9dc-2e19b2c83099 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:58.928958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d65b1f-2d7b-418a-a57b-bbeec14254ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:58.929890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65b1f-2d7b-418a-a57b-bbeec14254ad admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:58.930188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65b1f-2d7b-418a-a57b-bbeec14254ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:58.930528 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65b1f-2d7b-418a-a57b-bbeec14254ad admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:58.931192 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d65b1f-2d7b-418a-a57b-bbeec14254ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:58.933236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d65b1f-2d7b-418a-a57b-bbeec14254ad admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:58.962587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1294/2600] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:04:58 2021] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:04:58.963880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a59ef-06b4-418d-8bd3-9cac8593a495 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:58.975212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a59ef-06b4-418d-8bd3-9cac8593a495 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:59.042712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a527ed-e528-464b-936f-899bdbf9a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:59.043450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a527ed-e528-464b-936f-899bdbf9a763 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:59.043731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a527ed-e528-464b-936f-899bdbf9a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:59.044008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a527ed-e528-464b-936f-899bdbf9a763 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:59.045236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a527ed-e528-464b-936f-899bdbf9a763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:59.047200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a527ed-e528-464b-936f-899bdbf9a763 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:59.066526 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1307/2601] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:04:58 2021] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:04:59.070353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d65b1f-2d7b-418a-a57b-bbeec14254ad admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:59.080210 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d65b1f-2d7b-418a-a57b-bbeec14254ad admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:59.084488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aad124-6b12-483c-98df-390190bc2036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:59.085075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aad124-6b12-483c-98df-390190bc2036 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:59.085360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aad124-6b12-483c-98df-390190bc2036 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:59.085641 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aad124-6b12-483c-98df-390190bc2036 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:59.086331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aad124-6b12-483c-98df-390190bc2036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:59.087909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aad124-6b12-483c-98df-390190bc2036 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:59.100749 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1295/2602] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:04:59.104913 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a527ed-e528-464b-936f-899bdbf9a763 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:59.116613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a527ed-e528-464b-936f-899bdbf9a763 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:59.121599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8e3ff-fa1c-41d3-9d68-c39385e3d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:59.122515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8e3ff-fa1c-41d3-9d68-c39385e3d819 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:59.122807 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8e3ff-fa1c-41d3-9d68-c39385e3d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:59.123090 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8e3ff-fa1c-41d3-9d68-c39385e3d819 admin admin] PATH_INFO: `/v3/projects/3ac9f63713d04e8a88330a91c0d03e80/users/3f259cc4ee9241b7bac31af8cb4b24a0/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:59.144144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8e3ff-fa1c-41d3-9d68-c39385e3d819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac9f63713d04e8a88330a91c0d03e80, user_id=3f259cc4ee9241b7bac31af8cb4b24a0, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:59.146928 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8e3ff-fa1c-41d3-9d68-c39385e3d819 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:59.160499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1308/2603] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:04:59 2021] PUT /identity/v3/projects/3ac9f63713d04e8a88330a91c0d03e80/users/3f259cc4ee9241b7bac31af8cb4b24a0/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:04:59.165058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aad124-6b12-483c-98df-390190bc2036 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:59.175176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aad124-6b12-483c-98df-390190bc2036 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:59.237810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d54003-e301-4036-a883-c890c34422c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:59.238432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54003-e301-4036-a883-c890c34422c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:59.238727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54003-e301-4036-a883-c890c34422c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:59.239120 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54003-e301-4036-a883-c890c34422c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:59.239817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d54003-e301-4036-a883-c890c34422c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:59.241467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d54003-e301-4036-a883-c890c34422c7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:59.251425 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1296/2604] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:04:59 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:04:59.255532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8e3ff-fa1c-41d3-9d68-c39385e3d819 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:59.265677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8e3ff-fa1c-41d3-9d68-c39385e3d819 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:59.270039 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:59.270887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:59.271173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:59.271451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] PATH_INFO: `/v3/projects/3ac9f63713d04e8a88330a91c0d03e80/users/3f259cc4ee9241b7bac31af8cb4b24a0/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:59.273234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac9f63713d04e8a88330a91c0d03e80, user_id=3f259cc4ee9241b7bac31af8cb4b24a0, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:59.275935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:59.287418 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1309/2605] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:04:59 2021] PUT /identity/v3/projects/3ac9f63713d04e8a88330a91c0d03e80/users/3f259cc4ee9241b7bac31af8cb4b24a0/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:04:59.297044 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86ef1-6230-4369-a445-8cf8ccd3f7bd None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:59.297414 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86ef1-6230-4369-a445-8cf8ccd3f7bd None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:59.297919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86ef1-6230-4369-a445-8cf8ccd3f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:59.340682 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-fef86ef1-6230-4369-a445-8cf8ccd3f7bd None None] MFA Rules not processed for user `3f259cc4ee9241b7bac31af8cb4b24a0`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:04:59.342314 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fef86ef1-6230-4369-a445-8cf8ccd3f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:59.421957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1297/2606] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:04:59 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:04:59.430741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:04:59.432684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:04:59.499223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c9e30-687f-45ab-aa6d-02289130b9ef admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:04:59.502825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422dbbe-cdd4-4392-be2b-4434f4f3eb64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:04:59.503413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422dbbe-cdd4-4392-be2b-4434f4f3eb64 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:04:59.503703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422dbbe-cdd4-4392-be2b-4434f4f3eb64 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:04:59.503988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422dbbe-cdd4-4392-be2b-4434f4f3eb64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:04:59.513779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422dbbe-cdd4-4392-be2b-4434f4f3eb64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:04:59.515257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422dbbe-cdd4-4392-be2b-4434f4f3eb64 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:04:59.524962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1310/2607] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:04:59 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:01.425350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86ef1-6230-4369-a445-8cf8ccd3f7bd None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:01.516085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86ef1-6230-4369-a445-8cf8ccd3f7bd None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:01.520672 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:01.521563 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:01.521917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:01.522318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] PATH_INFO: `/v3/users/3dd25ec458814507bf2364828f55e342` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:01.523608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd25ec458814507bf2364828f55e342)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:01.525614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:01.585098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd25ec458814507bf2364828f55e342'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:01.593505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd25ec458814507bf2364828f55e342'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:01.594238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd25ec458814507bf2364828f55e342'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:01.594925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd25ec458814507bf2364828f55e342'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:01.603505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd25ec458814507bf2364828f55e342'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:01.623790 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1298/2608] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:05:01 2021] DELETE /identity/v3/users/3dd25ec458814507bf2364828f55e342 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:01.628123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c29e-93bd-49b9-96ee-c50ccdce1e68 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:01.628630 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c29e-93bd-49b9-96ee-c50ccdce1e68 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:01.628742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c29e-93bd-49b9-96ee-c50ccdce1e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:01.659041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1533c29e-93bd-49b9-96ee-c50ccdce1e68 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:01.660705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1533c29e-93bd-49b9-96ee-c50ccdce1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:01.750898 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1311/2609] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:01.764801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:01.766545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:01.931040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e0e60-20fc-4591-80e7-51ac6544585a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:01.940551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3856b-efa2-402a-b93c-6285d8556786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:01.941737 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3856b-efa2-402a-b93c-6285d8556786 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:01.942200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3856b-efa2-402a-b93c-6285d8556786 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:01.942678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3856b-efa2-402a-b93c-6285d8556786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:01.959139 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3856b-efa2-402a-b93c-6285d8556786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:01.960785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3856b-efa2-402a-b93c-6285d8556786 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:01.984686 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1299/2610] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:05:02.363055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533c29e-93bd-49b9-96ee-c50ccdce1e68 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:02.364432 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1533c29e-93bd-49b9-96ee-c50ccdce1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:02.376122 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533c29e-93bd-49b9-96ee-c50ccdce1e68 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:02.380941 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:02.381741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:02.382028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:02.382310 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] PATH_INFO: `/v3/projects/c24603af44734d44900fdeed2eecb639` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:02.383465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24603af44734d44900fdeed2eecb639)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:02.385363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:02.436079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24603af44734d44900fdeed2eecb639', 'request_id': 'req-3d8e7a3e-9026-4349-9db6-d72686403879'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.441034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24603af44734d44900fdeed2eecb639', 'request_id': 'req-3d8e7a3e-9026-4349-9db6-d72686403879'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.448355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24603af44734d44900fdeed2eecb639', 'request_id': 'req-3d8e7a3e-9026-4349-9db6-d72686403879'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.465006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] The token cache is being invalidate because project c24603af44734d44900fdeed2eecb639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:05:02.465294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.465974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.468087 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1312/2611] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:05:02 2021] DELETE /identity/v3/projects/c24603af44734d44900fdeed2eecb639 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:02.472011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3856b-efa2-402a-b93c-6285d8556786 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:02.481414 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3856b-efa2-402a-b93c-6285d8556786 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:02.547715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:02.548552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:02.548842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:02.549123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] PATH_INFO: `/v3/users/3f259cc4ee9241b7bac31af8cb4b24a0` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:02.550240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f259cc4ee9241b7bac31af8cb4b24a0)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:02.552159 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:02.600793 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f259cc4ee9241b7bac31af8cb4b24a0'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.608266 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f259cc4ee9241b7bac31af8cb4b24a0'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.608867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f259cc4ee9241b7bac31af8cb4b24a0'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.609460 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f259cc4ee9241b7bac31af8cb4b24a0'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.617369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1208eccd-fc25-4b14-b4db-7c30d33d0a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f259cc4ee9241b7bac31af8cb4b24a0'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:02.634618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1300/2612] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:05:02 2021] DELETE /identity/v3/users/3f259cc4ee9241b7bac31af8cb4b24a0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:05:03.033113 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.034623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:03.053546 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e7a3e-9026-4349-9db6-d72686403879 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:03.123052 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:03.123880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.124152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.124437 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] PATH_INFO: `/v3/projects/3ac9f63713d04e8a88330a91c0d03e80` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.125587 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac9f63713d04e8a88330a91c0d03e80)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:03.127553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:03.177840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac9f63713d04e8a88330a91c0d03e80', 'request_id': 'req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:03.188812 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac9f63713d04e8a88330a91c0d03e80', 'request_id': 'req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:03.197700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac9f63713d04e8a88330a91c0d03e80', 'request_id': 'req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:03.217003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] The token cache is being invalidate because project 3ac9f63713d04e8a88330a91c0d03e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:05:03.217289 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:03.217938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2e1cb5cf-2534-4cd4-86d4-12a638034bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:03.219452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1313/2613] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:05:03 2021] DELETE /identity/v3/projects/3ac9f63713d04e8a88330a91c0d03e80 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:05:03.226096 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796779-a469-40ec-b129-1ed014991cb2 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.226393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796779-a469-40ec-b129-1ed014991cb2 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.226704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796779-a469-40ec-b129-1ed014991cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.251918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-98796779-a469-40ec-b129-1ed014991cb2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:03.253088 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-98796779-a469-40ec-b129-1ed014991cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:03.320310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1301/2614] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:05:03.329272 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111b6b-e2aa-4cef-9eb2-279a3e5ba3b8 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.329566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111b6b-e2aa-4cef-9eb2-279a3e5ba3b8 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.329864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111b6b-e2aa-4cef-9eb2-279a3e5ba3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.353428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-2c111b6b-e2aa-4cef-9eb2-279a3e5ba3b8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:03.355042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2c111b6b-e2aa-4cef-9eb2-279a3e5ba3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:03.363349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1314/2615] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:03.367797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98796779-a469-40ec-b129-1ed014991cb2 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.377390 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98796779-a469-40ec-b129-1ed014991cb2 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:03.381918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:03.382551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.382844 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.383127 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.383830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:05:03.384130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:03.385720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:03.398815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1302/2616] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:05:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:05:03.404018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c111b6b-e2aa-4cef-9eb2-279a3e5ba3b8 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.413201 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c111b6b-e2aa-4cef-9eb2-279a3e5ba3b8 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:03.417701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0167b-759b-47c3-9a24-561dd1b1c0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:03.420624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0167b-759b-47c3-9a24-561dd1b1c0cf admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.420624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0167b-759b-47c3-9a24-561dd1b1c0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.420624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0167b-759b-47c3-9a24-561dd1b1c0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.420624 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0167b-759b-47c3-9a24-561dd1b1c0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:03.425129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0167b-759b-47c3-9a24-561dd1b1c0cf admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:03.455037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1315/2617] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:05:03 2021] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:05:03.459446 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.469674 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61a43-8975-4f76-871a-de73f41b0b42 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:03.539776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8087e-6b41-4942-895a-06b80e54981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:03.539776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8087e-6b41-4942-895a-06b80e54981c admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.540764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8087e-6b41-4942-895a-06b80e54981c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.540764 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8087e-6b41-4942-895a-06b80e54981c admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.541054 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8087e-6b41-4942-895a-06b80e54981c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:03.542908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8087e-6b41-4942-895a-06b80e54981c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:03.565090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1303/2618] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:05:03 2021] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:05:03.569502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0167b-759b-47c3-9a24-561dd1b1c0cf admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.579968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0167b-759b-47c3-9a24-561dd1b1c0cf admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:03.584519 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504ab6-0c40-4c3b-b156-f4d2b9fa5ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:03.585179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504ab6-0c40-4c3b-b156-f4d2b9fa5ffc admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.585521 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504ab6-0c40-4c3b-b156-f4d2b9fa5ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.585754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504ab6-0c40-4c3b-b156-f4d2b9fa5ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.586475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92504ab6-0c40-4c3b-b156-f4d2b9fa5ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:03.588198 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92504ab6-0c40-4c3b-b156-f4d2b9fa5ffc admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:03.602495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1316/2619] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:05:03.603407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8087e-6b41-4942-895a-06b80e54981c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.615493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8087e-6b41-4942-895a-06b80e54981c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:03.621071 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd71b3-4bd6-41cc-8237-1c70b47fc023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:03.621697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd71b3-4bd6-41cc-8237-1c70b47fc023 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.622102 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd71b3-4bd6-41cc-8237-1c70b47fc023 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.622546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd71b3-4bd6-41cc-8237-1c70b47fc023 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.623166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd71b3-4bd6-41cc-8237-1c70b47fc023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:03.624743 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd71b3-4bd6-41cc-8237-1c70b47fc023 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:03.635369 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1304/2620] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:05:03.639813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504ab6-0c40-4c3b-b156-f4d2b9fa5ffc admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.649843 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504ab6-0c40-4c3b-b156-f4d2b9fa5ffc admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:03.655496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f766285-4a46-4152-a8b7-ae136f554ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:03.656339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f766285-4a46-4152-a8b7-ae136f554ded admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.656635 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f766285-4a46-4152-a8b7-ae136f554ded admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.656921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f766285-4a46-4152-a8b7-ae136f554ded admin admin] PATH_INFO: `/v3/projects/f5808891e5ef4fec80985128dd723a20/users/2fd747ddac814077b1e5e455c22fc9b1/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.678433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f766285-4a46-4152-a8b7-ae136f554ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5808891e5ef4fec80985128dd723a20, user_id=2fd747ddac814077b1e5e455c22fc9b1, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:03.681509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f766285-4a46-4152-a8b7-ae136f554ded admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:03.697462 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1317/2621] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:05:03 2021] PUT /identity/v3/projects/f5808891e5ef4fec80985128dd723a20/users/2fd747ddac814077b1e5e455c22fc9b1/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:05:03.708289 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ca48b-0aa7-46dc-bd87-ce0e35ac810b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.708587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ca48b-0aa7-46dc-bd87-ce0e35ac810b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.708925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ca48b-0aa7-46dc-bd87-ce0e35ac810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.751024 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-a74ca48b-0aa7-46dc-bd87-ce0e35ac810b None None] MFA Rules not processed for user `2fd747ddac814077b1e5e455c22fc9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:03.752438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-a74ca48b-0aa7-46dc-bd87-ce0e35ac810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:03.831467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1305/2622] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:03 2021] POST /identity/v3/auth/tokens => generated 3706 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:03.836037 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f766285-4a46-4152-a8b7-ae136f554ded admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.910648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f766285-4a46-4152-a8b7-ae136f554ded admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:03.916464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190e04a-ac3a-408f-9ab1-cffe0782461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:03.917469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190e04a-ac3a-408f-9ab1-cffe0782461d admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:03.918042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190e04a-ac3a-408f-9ab1-cffe0782461d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:03.918430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190e04a-ac3a-408f-9ab1-cffe0782461d admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:03.919405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190e04a-ac3a-408f-9ab1-cffe0782461d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:03.922185 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190e04a-ac3a-408f-9ab1-cffe0782461d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:03.958301 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1318/2623] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:05:03 2021] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:05:03.959444 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ca48b-0aa7-46dc-bd87-ce0e35ac810b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:03.971673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ca48b-0aa7-46dc-bd87-ce0e35ac810b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:04.043787 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae32c1-e3df-44d4-8901-87ee2d788565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:04.044453 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae32c1-e3df-44d4-8901-87ee2d788565 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.044728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae32c1-e3df-44d4-8901-87ee2d788565 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.045014 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae32c1-e3df-44d4-8901-87ee2d788565 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.045703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae32c1-e3df-44d4-8901-87ee2d788565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:04.047663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae32c1-e3df-44d4-8901-87ee2d788565 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:04.069650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1306/2624] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:05:03 2021] POST /identity/v3/users => generated 307 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:05:04.073692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190e04a-ac3a-408f-9ab1-cffe0782461d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:04.085219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190e04a-ac3a-408f-9ab1-cffe0782461d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:04.089872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb15b97-44ea-46cf-9fd4-522c6e3f7962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:04.090516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15b97-44ea-46cf-9fd4-522c6e3f7962 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.090844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15b97-44ea-46cf-9fd4-522c6e3f7962 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.091134 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15b97-44ea-46cf-9fd4-522c6e3f7962 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.091842 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb15b97-44ea-46cf-9fd4-522c6e3f7962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:04.093459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb15b97-44ea-46cf-9fd4-522c6e3f7962 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:04.105014 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1319/2625] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:05:04.110445 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae32c1-e3df-44d4-8901-87ee2d788565 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:04.127642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae32c1-e3df-44d4-8901-87ee2d788565 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:04.132262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbaa29-769e-4c6d-b6f7-d9f7932d79f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:04.133152 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbaa29-769e-4c6d-b6f7-d9f7932d79f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.133434 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbaa29-769e-4c6d-b6f7-d9f7932d79f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.133724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbaa29-769e-4c6d-b6f7-d9f7932d79f8 admin admin] PATH_INFO: `/v3/projects/266334fe2c094be784b9cd931d87e7be/users/da6ee1b3a8f148a18a16ff067e4ea15d/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.158374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbaa29-769e-4c6d-b6f7-d9f7932d79f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266334fe2c094be784b9cd931d87e7be, user_id=da6ee1b3a8f148a18a16ff067e4ea15d, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:04.161402 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbaa29-769e-4c6d-b6f7-d9f7932d79f8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:04.177220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1307/2626] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:05:04 2021] PUT /identity/v3/projects/266334fe2c094be784b9cd931d87e7be/users/da6ee1b3a8f148a18a16ff067e4ea15d/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:04.182131 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb15b97-44ea-46cf-9fd4-522c6e3f7962 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:04.193393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb15b97-44ea-46cf-9fd4-522c6e3f7962 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:04.284140 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122358b9-2379-406d-adc9-71136aaf314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:04.284844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122358b9-2379-406d-adc9-71136aaf314d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.285202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122358b9-2379-406d-adc9-71136aaf314d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.285551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122358b9-2379-406d-adc9-71136aaf314d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.286940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122358b9-2379-406d-adc9-71136aaf314d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:04.288559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122358b9-2379-406d-adc9-71136aaf314d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:04.303353 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1320/2627] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:04 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:05:04.307800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbaa29-769e-4c6d-b6f7-d9f7932d79f8 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:04.319683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbaa29-769e-4c6d-b6f7-d9f7932d79f8 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:04.324410 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:04.325939 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.326238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.326580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] PATH_INFO: `/v3/projects/266334fe2c094be784b9cd931d87e7be/users/da6ee1b3a8f148a18a16ff067e4ea15d/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.328468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=266334fe2c094be784b9cd931d87e7be, user_id=da6ee1b3a8f148a18a16ff067e4ea15d, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:04.331123 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:04.343437 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1308/2628] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:05:04 2021] PUT /identity/v3/projects/266334fe2c094be784b9cd931d87e7be/users/da6ee1b3a8f148a18a16ff067e4ea15d/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:05:04.354984 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8c62-3106-41a3-8a8a-096cd8c08908 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.355280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8c62-3106-41a3-8a8a-096cd8c08908 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.355551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8c62-3106-41a3-8a8a-096cd8c08908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.395459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b80a8c62-3106-41a3-8a8a-096cd8c08908 None None] MFA Rules not processed for user `da6ee1b3a8f148a18a16ff067e4ea15d`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:04.397631 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b80a8c62-3106-41a3-8a8a-096cd8c08908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:04.487716 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1321/2629] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:04 2021] POST /identity/v3/auth/tokens => generated 3775 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:05:04.498918 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:04.501733 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:04.552511 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7383cff-9bd9-46be-b958-3937fa252b44 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.552877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7383cff-9bd9-46be-b958-3937fa252b44 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.553241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7383cff-9bd9-46be-b958-3937fa252b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.575677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-d7383cff-9bd9-46be-b958-3937fa252b44 None None] MFA Rules not processed for user `dee892a81cba413da63a4bbf1573fa94`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:04.576843 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d7383cff-9bd9-46be-b958-3937fa252b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:04.585816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec581a06-340e-43ae-a54e-b89906b304cc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:04.590514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fa349-1c91-42b6-895d-67fdad286cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:04.591267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fa349-1c91-42b6-895d-67fdad286cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.591564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fa349-1c91-42b6-895d-67fdad286cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.591843 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fa349-1c91-42b6-895d-67fdad286cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.603727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fa349-1c91-42b6-895d-67fdad286cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:04.604878 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fa349-1c91-42b6-895d-67fdad286cb9 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:04.615754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1309/2630] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:04 2021] GET /identity/v3/auth/tokens => generated 3775 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:04.644633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1322/2631] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:04 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:05:04.755624 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fa349-1c91-42b6-895d-67fdad286cb9 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:04.765829 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fa349-1c91-42b6-895d-67fdad286cb9 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:04.769862 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984d01c-1120-48a9-859e-662967ccd708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:04.770509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984d01c-1120-48a9-859e-662967ccd708 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:04.770930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984d01c-1120-48a9-859e-662967ccd708 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:04.771211 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984d01c-1120-48a9-859e-662967ccd708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:04.875763 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984d01c-1120-48a9-859e-662967ccd708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:04.878605 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984d01c-1120-48a9-859e-662967ccd708 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:04.895917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1310/2632] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:04 2021] GET /identity/v3/auth/tokens => generated 3706 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:05:05.395589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7383cff-9bd9-46be-b958-3937fa252b44 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:05.397271 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d7383cff-9bd9-46be-b958-3937fa252b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:05.460591 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7383cff-9bd9-46be-b958-3937fa252b44 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:05.464060 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5492ba-ea81-4f50-a973-b5169a8533f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:05.464643 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5492ba-ea81-4f50-a973-b5169a8533f2 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:05.464935 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5492ba-ea81-4f50-a973-b5169a8533f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:05.465218 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5492ba-ea81-4f50-a973-b5169a8533f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:05.467671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ee5492ba-ea81-4f50-a973-b5169a8533f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:05.477333 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5492ba-ea81-4f50-a973-b5169a8533f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:05.478810 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5492ba-ea81-4f50-a973-b5169a8533f2 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:05.486864 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1323/2633] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:05 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:09.767606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984d01c-1120-48a9-859e-662967ccd708 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:09.893945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984d01c-1120-48a9-859e-662967ccd708 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:09.900062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:09.901025 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:09.901407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:09.901698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] PATH_INFO: `/v3/users/2fd747ddac814077b1e5e455c22fc9b1` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:09.902933 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd747ddac814077b1e5e455c22fc9b1)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:09.905853 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:09.977873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd747ddac814077b1e5e455c22fc9b1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:09.990356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd747ddac814077b1e5e455c22fc9b1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:09.991800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd747ddac814077b1e5e455c22fc9b1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:09.993137 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd747ddac814077b1e5e455c22fc9b1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.009854 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd747ddac814077b1e5e455c22fc9b1'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.039051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1311/2634] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:05:09 2021] DELETE /identity/v3/users/2fd747ddac814077b1e5e455c22fc9b1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:10.044460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff87b88-3078-44be-a296-be3c929b1c53 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:10.044963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff87b88-3078-44be-a296-be3c929b1c53 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:10.045612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff87b88-3078-44be-a296-be3c929b1c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:10.072270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-fff87b88-3078-44be-a296-be3c929b1c53 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:10.073772 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fff87b88-3078-44be-a296-be3c929b1c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:10.145239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1324/2635] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:10.156993 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:10.158551 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:10.234165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09408711-172b-4576-9616-ee9cd055cc06 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:10.237725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127fa82-71c1-4078-97cc-51d9b253e78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:10.238318 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fa82-71c1-4078-97cc-51d9b253e78f service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:10.238642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fa82-71c1-4078-97cc-51d9b253e78f service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:10.238929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fa82-71c1-4078-97cc-51d9b253e78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:10.249048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127fa82-71c1-4078-97cc-51d9b253e78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:10.250615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127fa82-71c1-4078-97cc-51d9b253e78f service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:10.260363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1312/2636] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:10.631763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff87b88-3078-44be-a296-be3c929b1c53 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:10.633428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fff87b88-3078-44be-a296-be3c929b1c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:10.645611 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff87b88-3078-44be-a296-be3c929b1c53 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:10.650448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:10.651447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:10.651745 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:10.652031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] PATH_INFO: `/v3/projects/f5808891e5ef4fec80985128dd723a20` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:10.653150 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5808891e5ef4fec80985128dd723a20)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:10.655114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:10.707645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5808891e5ef4fec80985128dd723a20', 'request_id': 'req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.712727 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5808891e5ef4fec80985128dd723a20', 'request_id': 'req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.720059 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5808891e5ef4fec80985128dd723a20', 'request_id': 'req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.737355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] The token cache is being invalidate because project f5808891e5ef4fec80985128dd723a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:05:10.737646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.738561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.740057 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1325/2637] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:05:10 2021] DELETE /identity/v3/projects/f5808891e5ef4fec80985128dd723a20 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:10.744305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127fa82-71c1-4078-97cc-51d9b253e78f service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:10.754286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127fa82-71c1-4078-97cc-51d9b253e78f service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:10.829950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:10.830677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:10.831200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:10.831200 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] PATH_INFO: `/v3/users/da6ee1b3a8f148a18a16ff067e4ea15d` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:10.832426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6ee1b3a8f148a18a16ff067e4ea15d)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:10.834699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:10.895354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6ee1b3a8f148a18a16ff067e4ea15d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.904057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6ee1b3a8f148a18a16ff067e4ea15d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.904685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6ee1b3a8f148a18a16ff067e4ea15d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.905307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6ee1b3a8f148a18a16ff067e4ea15d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.914569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-0037b94d-1af5-4386-b639-5bc586b93314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6ee1b3a8f148a18a16ff067e4ea15d'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:10.933117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1313/2638] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:05:10 2021] DELETE /identity/v3/users/da6ee1b3a8f148a18a16ff067e4ea15d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:11.339799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:11.341736 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:11.354130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee2b34-9c5f-4806-ba5f-71066b116ebb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:11.418270 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:11.419114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.419405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.419684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] PATH_INFO: `/v3/projects/266334fe2c094be784b9cd931d87e7be` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.420816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266334fe2c094be784b9cd931d87e7be)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:11.422717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:11.473143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266334fe2c094be784b9cd931d87e7be', 'request_id': 'req-dd0a03f5-a842-42c2-b322-3222ff1b5923'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:11.478183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266334fe2c094be784b9cd931d87e7be', 'request_id': 'req-dd0a03f5-a842-42c2-b322-3222ff1b5923'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:11.485285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266334fe2c094be784b9cd931d87e7be', 'request_id': 'req-dd0a03f5-a842-42c2-b322-3222ff1b5923'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:11.502051 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] The token cache is being invalidate because project 266334fe2c094be784b9cd931d87e7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:05:11.502339 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:11.503005 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-dd0a03f5-a842-42c2-b322-3222ff1b5923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:11.504494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1326/2639] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:05:11 2021] DELETE /identity/v3/projects/266334fe2c094be784b9cd931d87e7be => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:05:11.510235 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801547ee-83c4-4dce-ab86-ebe7dc60715b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.510580 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801547ee-83c4-4dce-ab86-ebe7dc60715b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.510865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801547ee-83c4-4dce-ab86-ebe7dc60715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.534219 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-801547ee-83c4-4dce-ab86-ebe7dc60715b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:11.535406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-801547ee-83c4-4dce-ab86-ebe7dc60715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:11.599233 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1314/2640] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:11.607118 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722776c-7f78-48b9-a90d-27f2bf2556f8 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.607415 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722776c-7f78-48b9-a90d-27f2bf2556f8 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.607705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722776c-7f78-48b9-a90d-27f2bf2556f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.630378 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a722776c-7f78-48b9-a90d-27f2bf2556f8 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:11.631479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a722776c-7f78-48b9-a90d-27f2bf2556f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:11.639361 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1327/2641] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:11.643526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801547ee-83c4-4dce-ab86-ebe7dc60715b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:11.652746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801547ee-83c4-4dce-ab86-ebe7dc60715b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:11.657023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:11.657604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.657892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.658178 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.658899 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:05:11.659196 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:11.660767 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:11.673019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1315/2642] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:05:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:05:11.677357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722776c-7f78-48b9-a90d-27f2bf2556f8 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:11.686806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722776c-7f78-48b9-a90d-27f2bf2556f8 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:11.691248 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093f356-6cff-43cd-bcd9-6adb3ae1790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:11.691851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093f356-6cff-43cd-bcd9-6adb3ae1790f admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.692135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093f356-6cff-43cd-bcd9-6adb3ae1790f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.692413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093f356-6cff-43cd-bcd9-6adb3ae1790f admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.693048 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093f356-6cff-43cd-bcd9-6adb3ae1790f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:11.694962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093f356-6cff-43cd-bcd9-6adb3ae1790f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:11.721285 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1328/2643] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:05:11 2021] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:05:11.725712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:11.735842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a204034-84fe-42cf-a9b3-1a73e0c829fa admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:11.798016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d1397-ba02-430b-9224-86b744a74b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:11.798717 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d1397-ba02-430b-9224-86b744a74b45 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.799011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d1397-ba02-430b-9224-86b744a74b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.799298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d1397-ba02-430b-9224-86b744a74b45 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.799950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d1397-ba02-430b-9224-86b744a74b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:11.801964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d1397-ba02-430b-9224-86b744a74b45 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:11.823801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1316/2644] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:05:11 2021] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:05:11.828407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093f356-6cff-43cd-bcd9-6adb3ae1790f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:11.839393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093f356-6cff-43cd-bcd9-6adb3ae1790f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:11.843879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b913a-69b0-45ba-82d6-5467b625c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:11.844487 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b913a-69b0-45ba-82d6-5467b625c0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.844799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b913a-69b0-45ba-82d6-5467b625c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.845058 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b913a-69b0-45ba-82d6-5467b625c0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.845758 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b913a-69b0-45ba-82d6-5467b625c0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:11.847396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b913a-69b0-45ba-82d6-5467b625c0e7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:11.858309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1329/2645] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:05:11.862569 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d1397-ba02-430b-9224-86b744a74b45 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:11.872908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d1397-ba02-430b-9224-86b744a74b45 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:11.877354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3a9ab-3766-4b2d-833b-7cff56eb55d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:11.877946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3a9ab-3766-4b2d-833b-7cff56eb55d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.878231 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3a9ab-3766-4b2d-833b-7cff56eb55d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.878557 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3a9ab-3766-4b2d-833b-7cff56eb55d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.879254 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3a9ab-3766-4b2d-833b-7cff56eb55d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:11.880896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3a9ab-3766-4b2d-833b-7cff56eb55d4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:11.891456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1317/2646] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:05:11.895568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b913a-69b0-45ba-82d6-5467b625c0e7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:11.905097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b913a-69b0-45ba-82d6-5467b625c0e7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:11.909443 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:11.910251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.910575 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.910856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] PATH_INFO: `/v3/projects/12e23dff25314ecca6051f387f3ff402/users/41eccad6234045ecb0195a940ffcea12/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.930778 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e23dff25314ecca6051f387f3ff402, user_id=41eccad6234045ecb0195a940ffcea12, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:11.933475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:11.948352 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1330/2647] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:05:11 2021] PUT /identity/v3/projects/12e23dff25314ecca6051f387f3ff402/users/41eccad6234045ecb0195a940ffcea12/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:11.958677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006f813-e391-428f-bad5-ba4e4ef91417 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:11.958972 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006f813-e391-428f-bad5-ba4e4ef91417 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:11.959253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006f813-e391-428f-bad5-ba4e4ef91417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:11.995603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-e006f813-e391-428f-bad5-ba4e4ef91417 None None] MFA Rules not processed for user `41eccad6234045ecb0195a940ffcea12`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:11.997505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-e006f813-e391-428f-bad5-ba4e4ef91417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:12.071745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1318/2648] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:11 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:12.081764 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:12.083440 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:12.148491 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf402d49-815e-454d-b038-4e1cd56f44e3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:12.151957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8fb19-b4a6-43d6-bce7-16f7718011f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:12.152540 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8fb19-b4a6-43d6-bce7-16f7718011f8 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:12.152825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8fb19-b4a6-43d6-bce7-16f7718011f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:12.153135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8fb19-b4a6-43d6-bce7-16f7718011f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:12.162129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8fb19-b4a6-43d6-bce7-16f7718011f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:12.163651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8fb19-b4a6-43d6-bce7-16f7718011f8 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:12.173655 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1331/2649] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:12 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:12.193824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006f813-e391-428f-bad5-ba4e4ef91417 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:12.267405 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006f813-e391-428f-bad5-ba4e4ef91417 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:12.271955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:12.272750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:12.273039 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:12.273323 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] PATH_INFO: `/v3/users/41eccad6234045ecb0195a940ffcea12` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:12.274554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41eccad6234045ecb0195a940ffcea12)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:12.276497 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:12.324329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41eccad6234045ecb0195a940ffcea12'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:12.332587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41eccad6234045ecb0195a940ffcea12'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:12.333218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41eccad6234045ecb0195a940ffcea12'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:12.333922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41eccad6234045ecb0195a940ffcea12'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:12.342476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41eccad6234045ecb0195a940ffcea12'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:12.359957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1319/2650] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:05:12 2021] DELETE /identity/v3/users/41eccad6234045ecb0195a940ffcea12 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:12.364865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b411-c3ca-49ca-a71f-db8e17836eac None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:12.365355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b411-c3ca-49ca-a71f-db8e17836eac None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:12.365632 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b411-c3ca-49ca-a71f-db8e17836eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:12.388609 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-8003b411-c3ca-49ca-a71f-db8e17836eac None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:12.389927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8003b411-c3ca-49ca-a71f-db8e17836eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:12.454890 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1332/2651] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:12.466262 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:12.467824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:12.535017 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb89896-fa32-470d-8427-1ba684e2be84 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:12.538663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7b5e4-dedf-4045-9fe4-382bf9afe193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:12.539248 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7b5e4-dedf-4045-9fe4-382bf9afe193 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:12.539539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7b5e4-dedf-4045-9fe4-382bf9afe193 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:12.539822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7b5e4-dedf-4045-9fe4-382bf9afe193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:12.549887 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7b5e4-dedf-4045-9fe4-382bf9afe193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:12.551376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7b5e4-dedf-4045-9fe4-382bf9afe193 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:12.561265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1320/2652] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:12.915372 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003b411-c3ca-49ca-a71f-db8e17836eac None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:12.916725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8003b411-c3ca-49ca-a71f-db8e17836eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:12.928571 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003b411-c3ca-49ca-a71f-db8e17836eac None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:12.934320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:12.935212 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:12.935505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:12.935790 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] PATH_INFO: `/v3/projects/12e23dff25314ecca6051f387f3ff402` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:12.937398 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e23dff25314ecca6051f387f3ff402)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:12.939346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:13.005829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e23dff25314ecca6051f387f3ff402', 'request_id': 'req-30140a89-a55d-498b-9fc3-f636febe3415'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:13.010669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e23dff25314ecca6051f387f3ff402', 'request_id': 'req-30140a89-a55d-498b-9fc3-f636febe3415'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:13.018753 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e23dff25314ecca6051f387f3ff402', 'request_id': 'req-30140a89-a55d-498b-9fc3-f636febe3415'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:13.038613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] The token cache is being invalidate because project 12e23dff25314ecca6051f387f3ff402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:05:13.038896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:13.039561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-30140a89-a55d-498b-9fc3-f636febe3415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:13.041027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1333/2653] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:05:12 2021] DELETE /identity/v3/projects/12e23dff25314ecca6051f387f3ff402 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:13.048697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a81ed-b2b7-4dce-823b-3976e89a9cfa None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.049190 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a81ed-b2b7-4dce-823b-3976e89a9cfa None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.049311 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a81ed-b2b7-4dce-823b-3976e89a9cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.071819 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-825a81ed-b2b7-4dce-823b-3976e89a9cfa None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:13.073053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-825a81ed-b2b7-4dce-823b-3976e89a9cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:13.136959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1321/2654] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:13.146343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184af51-6aa1-47e9-ac2b-bd0956652f60 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.146668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184af51-6aa1-47e9-ac2b-bd0956652f60 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.146957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184af51-6aa1-47e9-ac2b-bd0956652f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.169031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-3184af51-6aa1-47e9-ac2b-bd0956652f60 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:13.170355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3184af51-6aa1-47e9-ac2b-bd0956652f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:13.177849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1334/2655] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:13.181991 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a81ed-b2b7-4dce-823b-3976e89a9cfa None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:13.191948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a81ed-b2b7-4dce-823b-3976e89a9cfa None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:13.197602 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:13.198202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.198523 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.198806 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.199506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:05:13.199809 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:13.201948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:13.214924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1322/2656] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:05:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 15:05:13.219442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184af51-6aa1-47e9-ac2b-bd0956652f60 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:13.228356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184af51-6aa1-47e9-ac2b-bd0956652f60 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:13.232724 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb169-c8da-4eb0-b59b-a5bc8e81df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:13.233556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb169-c8da-4eb0-b59b-a5bc8e81df5d admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.233845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb169-c8da-4eb0-b59b-a5bc8e81df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.234126 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb169-c8da-4eb0-b59b-a5bc8e81df5d admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.234809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb169-c8da-4eb0-b59b-a5bc8e81df5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:13.236711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb169-c8da-4eb0-b59b-a5bc8e81df5d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:13.263374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1335/2657] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:05:13 2021] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:05:13.268877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:13.280615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd632e-207f-49ed-a9d8-2d594807ae4a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:13.355610 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aeffb-b481-4adb-8e11-2f9ae656c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:13.356246 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aeffb-b481-4adb-8e11-2f9ae656c1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.356538 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aeffb-b481-4adb-8e11-2f9ae656c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.356820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aeffb-b481-4adb-8e11-2f9ae656c1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.357468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aeffb-b481-4adb-8e11-2f9ae656c1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:13.359669 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aeffb-b481-4adb-8e11-2f9ae656c1a2 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:13.385574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1323/2658] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:05:13 2021] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:05:13.387153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb169-c8da-4eb0-b59b-a5bc8e81df5d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:13.398204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb169-c8da-4eb0-b59b-a5bc8e81df5d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:13.403182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c082e6-691c-43c2-85b9-daee4a37e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:13.403837 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c082e6-691c-43c2-85b9-daee4a37e033 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.404128 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c082e6-691c-43c2-85b9-daee4a37e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.404407 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c082e6-691c-43c2-85b9-daee4a37e033 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.405107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c082e6-691c-43c2-85b9-daee4a37e033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:13.406749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c082e6-691c-43c2-85b9-daee4a37e033 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:13.417318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1336/2659] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:05:13.422754 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aeffb-b481-4adb-8e11-2f9ae656c1a2 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:13.433578 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aeffb-b481-4adb-8e11-2f9ae656c1a2 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:13.439562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c022fc-2acd-4dfb-b942-b18e3e15fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:13.440271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c022fc-2acd-4dfb-b942-b18e3e15fc8f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.440608 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c022fc-2acd-4dfb-b942-b18e3e15fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.440979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c022fc-2acd-4dfb-b942-b18e3e15fc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.441744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c022fc-2acd-4dfb-b942-b18e3e15fc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:13.443443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c022fc-2acd-4dfb-b942-b18e3e15fc8f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:13.454046 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1324/2660] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:05:13.458594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c082e6-691c-43c2-85b9-daee4a37e033 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:13.468886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c082e6-691c-43c2-85b9-daee4a37e033 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:13.473792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:13.474642 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.474927 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.475235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] PATH_INFO: `/v3/projects/78e3da1b3eec4a118c05bacab5667e8c/users/7c8ced6932af4527a8113b84ea021aa9/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.497584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e3da1b3eec4a118c05bacab5667e8c, user_id=7c8ced6932af4527a8113b84ea021aa9, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:13.500304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:13.515569 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1337/2661] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:05:13 2021] PUT /identity/v3/projects/78e3da1b3eec4a118c05bacab5667e8c/users/7c8ced6932af4527a8113b84ea021aa9/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:13.525773 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4868a2-efc7-4e65-9e5a-625374762c07 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.526065 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4868a2-efc7-4e65-9e5a-625374762c07 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.526354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4868a2-efc7-4e65-9e5a-625374762c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.568016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ad4868a2-efc7-4e65-9e5a-625374762c07 None None] MFA Rules not processed for user `7c8ced6932af4527a8113b84ea021aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:13.569283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ad4868a2-efc7-4e65-9e5a-625374762c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:13.653505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1325/2662] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:13 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:13.665459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:13.667392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:13.737549 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589360e-5b6c-4d4a-bd65-ade90311602f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:13.741859 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0f395-d49e-4158-b220-c129c990766c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92f456ee8cf4564aaca2b16f320b49d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:13.742633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f395-d49e-4158-b220-c129c990766c service glance] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:13.743105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f395-d49e-4158-b220-c129c990766c service glance] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:13.743760 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f395-d49e-4158-b220-c129c990766c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:13.754494 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0f395-d49e-4158-b220-c129c990766c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:13.755978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0f395-d49e-4158-b220-c129c990766c service glance] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:13.766081 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1338/2663] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:13 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:44.315725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4868a2-efc7-4e65-9e5a-625374762c07 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:44.395239 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4868a2-efc7-4e65-9e5a-625374762c07 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:44.400576 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:44.401948 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:44.402247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:44.402565 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] PATH_INFO: `/v3/users/7c8ced6932af4527a8113b84ea021aa9` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:44.404808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8ced6932af4527a8113b84ea021aa9)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:44.407130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:44.473886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8ced6932af4527a8113b84ea021aa9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:44.482512 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8ced6932af4527a8113b84ea021aa9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:44.483959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8ced6932af4527a8113b84ea021aa9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:44.484586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8ced6932af4527a8113b84ea021aa9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:44.492931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8ced6932af4527a8113b84ea021aa9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:44.512579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1326/2664] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:05:44 2021] DELETE /identity/v3/users/7c8ced6932af4527a8113b84ea021aa9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:44.517433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25b0e-e169-4f79-a2b6-8bed7cd3d779 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:44.518006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25b0e-e169-4f79-a2b6-8bed7cd3d779 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:44.518006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25b0e-e169-4f79-a2b6-8bed7cd3d779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:44.541610 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-42b25b0e-e169-4f79-a2b6-8bed7cd3d779 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:44.542921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-42b25b0e-e169-4f79-a2b6-8bed7cd3d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:44.610311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1339/2665] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:05:44.620716 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:44.622106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:44.688722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73d93-6403-4cc2-af85-641d9d814ae0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:44.692276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e83444-82ad-4438-af10-551dec15d4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:44.692859 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e83444-82ad-4438-af10-551dec15d4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:44.693148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e83444-82ad-4438-af10-551dec15d4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:44.693435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e83444-82ad-4438-af10-551dec15d4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:44.704186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e83444-82ad-4438-af10-551dec15d4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:44.707069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e83444-82ad-4438-af10-551dec15d4f5 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:44.725929 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1327/2666] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:05:45.230623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25b0e-e169-4f79-a2b6-8bed7cd3d779 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:45.232100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-42b25b0e-e169-4f79-a2b6-8bed7cd3d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:45.252138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25b0e-e169-4f79-a2b6-8bed7cd3d779 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:45.256678 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:45.257479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.257763 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.258041 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] PATH_INFO: `/v3/projects/78e3da1b3eec4a118c05bacab5667e8c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.259208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e3da1b3eec4a118c05bacab5667e8c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:45.261106 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:45.314505 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e3da1b3eec4a118c05bacab5667e8c', 'request_id': 'req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:45.319377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e3da1b3eec4a118c05bacab5667e8c', 'request_id': 'req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:45.326588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e3da1b3eec4a118c05bacab5667e8c', 'request_id': 'req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:45.343518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] The token cache is being invalidate because project 78e3da1b3eec4a118c05bacab5667e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:05:45.343822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:45.344477 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-45b6a99a-fb5c-4056-a2c8-0e970c1fdc2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:05:45.345973 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1340/2667] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:05:45 2021] DELETE /identity/v3/projects/78e3da1b3eec4a118c05bacab5667e8c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:45.351571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7a524-f6d9-4205-b5f1-dbc95a1ca035 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.352086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7a524-f6d9-4205-b5f1-dbc95a1ca035 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.352187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7a524-f6d9-4205-b5f1-dbc95a1ca035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.376070 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-fcd7a524-f6d9-4205-b5f1-dbc95a1ca035 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:45.377244 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-fcd7a524-f6d9-4205-b5f1-dbc95a1ca035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:45.444406 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1328/2668] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:45.452850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e37c-023d-46d8-aa63-082c7789dd14 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.453086 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e37c-023d-46d8-aa63-082c7789dd14 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.453373 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e37c-023d-46d8-aa63-082c7789dd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.476247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-7686e37c-023d-46d8-aa63-082c7789dd14 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:45.477422 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7686e37c-023d-46d8-aa63-082c7789dd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:45.485281 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1341/2669] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:45.489660 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7a524-f6d9-4205-b5f1-dbc95a1ca035 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:45.499736 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7a524-f6d9-4205-b5f1-dbc95a1ca035 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:45.504443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:45.505075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.505366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.505650 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.506358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:05:45.506827 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:45.508435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:45.525722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1329/2670] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:05:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:05:45.527471 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e37c-023d-46d8-aa63-082c7789dd14 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:45.543940 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e37c-023d-46d8-aa63-082c7789dd14 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:45.549023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9ca2-5f61-4c44-8d0c-321a23deab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:45.549629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9ca2-5f61-4c44-8d0c-321a23deab6f admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.549921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9ca2-5f61-4c44-8d0c-321a23deab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.550204 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9ca2-5f61-4c44-8d0c-321a23deab6f admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.550887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc9ca2-5f61-4c44-8d0c-321a23deab6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:45.552825 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc9ca2-5f61-4c44-8d0c-321a23deab6f admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:45.597354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1342/2671] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:05:45 2021] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:05:45.598546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:45.610310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660808-c44b-4fcd-9e40-fa28e84a1088 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:45.684666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08071d-ff0d-4e8b-80e0-a24b3cd66841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:45.686688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08071d-ff0d-4e8b-80e0-a24b3cd66841 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.686688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08071d-ff0d-4e8b-80e0-a24b3cd66841 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.686688 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08071d-ff0d-4e8b-80e0-a24b3cd66841 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.687083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08071d-ff0d-4e8b-80e0-a24b3cd66841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:45.689053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08071d-ff0d-4e8b-80e0-a24b3cd66841 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:45.713327 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1330/2672] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:05:45 2021] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:05:45.717870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9ca2-5f61-4c44-8d0c-321a23deab6f admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:45.729849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9ca2-5f61-4c44-8d0c-321a23deab6f admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:45.735280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5c65-ee78-4ca6-9936-39a8fcfce378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:45.736002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5c65-ee78-4ca6-9936-39a8fcfce378 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.736367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5c65-ee78-4ca6-9936-39a8fcfce378 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.736711 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5c65-ee78-4ca6-9936-39a8fcfce378 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.737490 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d5c65-ee78-4ca6-9936-39a8fcfce378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:45.739225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d5c65-ee78-4ca6-9936-39a8fcfce378 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:45.756413 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1343/2673] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:45 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:05:45.760590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08071d-ff0d-4e8b-80e0-a24b3cd66841 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:45.771493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08071d-ff0d-4e8b-80e0-a24b3cd66841 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:45.776277 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48a4ce-91bc-4441-a1fa-4a628e0f46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:45.776950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a4ce-91bc-4441-a1fa-4a628e0f46e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.777307 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a4ce-91bc-4441-a1fa-4a628e0f46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.777651 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a4ce-91bc-4441-a1fa-4a628e0f46e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.778607 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48a4ce-91bc-4441-a1fa-4a628e0f46e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:45.780541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48a4ce-91bc-4441-a1fa-4a628e0f46e0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:45.794755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1331/2674] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:05:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:05:45.797152 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5c65-ee78-4ca6-9936-39a8fcfce378 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:45.807838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5c65-ee78-4ca6-9936-39a8fcfce378 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:45.813236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:45.814183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.814573 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.814974 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] PATH_INFO: `/v3/projects/e2ec7036cca2448699c475e1c99e7eb3/users/c24cda36a3f84367a4e0163a2e69ca61/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.835888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ec7036cca2448699c475e1c99e7eb3, user_id=c24cda36a3f84367a4e0163a2e69ca61, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:45.838638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:45.852181 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1344/2675] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:05:45 2021] PUT /identity/v3/projects/e2ec7036cca2448699c475e1c99e7eb3/users/c24cda36a3f84367a4e0163a2e69ca61/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:05:45.864206 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1070-573c-4761-8775-f63e62bc334c None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:45.864509 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1070-573c-4761-8775-f63e62bc334c None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:45.864822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1070-573c-4761-8775-f63e62bc334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:45.903110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-704d1070-573c-4761-8775-f63e62bc334c None None] MFA Rules not processed for user `c24cda36a3f84367a4e0163a2e69ca61`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:45.904285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-704d1070-573c-4761-8775-f63e62bc334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:45.981114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1332/2676] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:45 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:05:45.995510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:45.997151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:46.063472 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3971ca-c555-4125-b3a3-e68189a46a03 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:46.067275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:46.067862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:46.068145 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:46.068451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:46.077880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:46.079392 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:46.089101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1345/2677] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:45 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:05:51.877539 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d1070-573c-4761-8775-f63e62bc334c None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:51.878901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-704d1070-573c-4761-8775-f63e62bc334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:51.953412 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d1070-573c-4761-8775-f63e62bc334c None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:51.958424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bcc69-9439-4a2b-a171-aae0fb78ac22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:51.959020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bcc69-9439-4a2b-a171-aae0fb78ac22 service placement] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:51.959309 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bcc69-9439-4a2b-a171-aae0fb78ac22 service placement] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:51.959709 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bcc69-9439-4a2b-a171-aae0fb78ac22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:51.961404 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-745bcc69-9439-4a2b-a171-aae0fb78ac22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:51.973409 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bcc69-9439-4a2b-a171-aae0fb78ac22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:51.975020 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bcc69-9439-4a2b-a171-aae0fb78ac22 service placement] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:51.985529 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1333/2678] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:51 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:52.918626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:05:52.920409 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:52.990114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c034-2841-4eee-8de8-1f45d6913d3b service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:05:52.993780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:05:52.994368 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:52.994692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:52.994977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:52.996648 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:53.062622 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:05:53.064129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:05:53.072961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1346/2679] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:05:52 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:05:53.175316 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb509f-b065-4a0f-b8a8-0e9a29958449 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:05:53.176147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb509f-b065-4a0f-b8a8-0e9a29958449 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:05:53.176310 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb509f-b065-4a0f-b8a8-0e9a29958449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:05:53.199553 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-79eb509f-b065-4a0f-b8a8-0e9a29958449 None None] MFA Rules not processed for user `8b6c5ce8a6e342b492f56c29d5f8b473`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:05:53.200692 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-79eb509f-b065-4a0f-b8a8-0e9a29958449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:05:53.262421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1334/2680] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:05:53 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:06:05.774018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:05.783288 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bca30a-ef72-455b-8ce5-175f7fd14199 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:05.787143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a7c03-a244-4249-90d7-81ad74c466df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:05.787778 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a7c03-a244-4249-90d7-81ad74c466df service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:05.788065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a7c03-a244-4249-90d7-81ad74c466df service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:05.788346 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a7c03-a244-4249-90d7-81ad74c466df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:05.790219 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0f6a7c03-a244-4249-90d7-81ad74c466df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:05.877786 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a7c03-a244-4249-90d7-81ad74c466df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:05.879269 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a7c03-a244-4249-90d7-81ad74c466df service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:05.889110 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1347/2681] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:06:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:06:07.250808 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb509f-b065-4a0f-b8a8-0e9a29958449 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:07.262643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb509f-b065-4a0f-b8a8-0e9a29958449 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:07.272022 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:07.272925 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:07.273296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:07.273810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] PATH_INFO: `/v3/users/c24cda36a3f84367a4e0163a2e69ca61` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:07.277335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24cda36a3f84367a4e0163a2e69ca61)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:07.277335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:07.350353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24cda36a3f84367a4e0163a2e69ca61'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:07.362250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24cda36a3f84367a4e0163a2e69ca61'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:07.363358 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24cda36a3f84367a4e0163a2e69ca61'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:07.364353 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24cda36a3f84367a4e0163a2e69ca61'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:07.375797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24cda36a3f84367a4e0163a2e69ca61'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:07.400643 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1335/2682] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:06:07 2021] DELETE /identity/v3/users/c24cda36a3f84367a4e0163a2e69ca61 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:06:07.406388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0805-e062-42de-99fe-5ff8aee774a5 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:07.407008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0805-e062-42de-99fe-5ff8aee774a5 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:07.407008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0805-e062-42de-99fe-5ff8aee774a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:07.435311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1c8a0805-e062-42de-99fe-5ff8aee774a5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:06:07.438435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1c8a0805-e062-42de-99fe-5ff8aee774a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:07.529731 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1348/2683] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:06:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:06:07.546236 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:07.547729 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:07.618989 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e92666-03c7-44f6-ab63-6d074d08cbc9 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:07.622802 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:07.624023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:07.624312 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:07.624595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:07.635076 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:07.636521 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:07.647615 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1336/2684] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:06:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:06:08.111580 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a0805-e062-42de-99fe-5ff8aee774a5 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:08.114375 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1c8a0805-e062-42de-99fe-5ff8aee774a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:08.136583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a0805-e062-42de-99fe-5ff8aee774a5 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:08.142664 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:08.143789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:08.144199 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:08.144510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] PATH_INFO: `/v3/projects/e2ec7036cca2448699c475e1c99e7eb3` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:08.146371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ec7036cca2448699c475e1c99e7eb3)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:08.148478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:08.209243 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ec7036cca2448699c475e1c99e7eb3', 'request_id': 'req-b74b5cf0-fcde-49d4-bce5-db0ea9309314'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:08.216619 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ec7036cca2448699c475e1c99e7eb3', 'request_id': 'req-b74b5cf0-fcde-49d4-bce5-db0ea9309314'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:08.226067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ec7036cca2448699c475e1c99e7eb3', 'request_id': 'req-b74b5cf0-fcde-49d4-bce5-db0ea9309314'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:08.244377 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] The token cache is being invalidate because project e2ec7036cca2448699c475e1c99e7eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:06:08.244707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:08.245784 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:08.247666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1349/2685] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:06:08 2021] DELETE /identity/v3/projects/e2ec7036cca2448699c475e1c99e7eb3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:06:20.232488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:20.234298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:20.248174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502b6f8-0197-440d-8dbb-054199ba771a service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:20.328566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:20.329431 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:20.329734 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:20.330038 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] PATH_INFO: `/v3/users/3aee7075283f455ebb1693f09ecd276e` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:20.331470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aee7075283f455ebb1693f09ecd276e)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:20.333512 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:20.402526 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aee7075283f455ebb1693f09ecd276e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.412980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aee7075283f455ebb1693f09ecd276e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.413760 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aee7075283f455ebb1693f09ecd276e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.414636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aee7075283f455ebb1693f09ecd276e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.424472 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aee7075283f455ebb1693f09ecd276e'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.443992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1337/2686] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:06:20 2021] DELETE /identity/v3/users/3aee7075283f455ebb1693f09ecd276e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:06:20.730355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:20.732588 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:20.754955 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b5cf0-fcde-49d4-bce5-db0ea9309314 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:20.844562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:20.845964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:20.846315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:20.846836 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] PATH_INFO: `/v3/projects/851559b5d43e474aa0fb5071883e75fb` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:20.848838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=851559b5d43e474aa0fb5071883e75fb)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:20.851581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:20.918329 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851559b5d43e474aa0fb5071883e75fb', 'request_id': 'req-279d0a53-18a2-4f72-ac69-0c0188bb71ac'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.924499 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851559b5d43e474aa0fb5071883e75fb', 'request_id': 'req-279d0a53-18a2-4f72-ac69-0c0188bb71ac'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.937937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851559b5d43e474aa0fb5071883e75fb', 'request_id': 'req-279d0a53-18a2-4f72-ac69-0c0188bb71ac'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.957018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] The token cache is being invalidate because project 851559b5d43e474aa0fb5071883e75fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:06:20.957321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.957958 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:20.959593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1350/2687] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:06:20 2021] DELETE /identity/v3/projects/851559b5d43e474aa0fb5071883e75fb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:06:20.963777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:20.965186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:20.979932 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4944c-0813-4474-b752-f6d4d7f94c0f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:21.067919 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:21.069438 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:21.070048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:21.070723 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] PATH_INFO: `/v3/users/6446c590390540b19f1ba4a0c5320ad9` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:21.072890 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6446c590390540b19f1ba4a0c5320ad9)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:21.077151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:21.181881 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6446c590390540b19f1ba4a0c5320ad9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.196090 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6446c590390540b19f1ba4a0c5320ad9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.197510 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6446c590390540b19f1ba4a0c5320ad9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.198456 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6446c590390540b19f1ba4a0c5320ad9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.220155 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-15f98f42-8485-46b6-8f31-398b5979db75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6446c590390540b19f1ba4a0c5320ad9'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.249876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1338/2688] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:06:20 2021] DELETE /identity/v3/users/6446c590390540b19f1ba4a0c5320ad9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:06:21.529355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:21.534186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:21.549962 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d0a53-18a2-4f72-ac69-0c0188bb71ac admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:21.630107 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:21.631186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:21.631892 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:21.632464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] PATH_INFO: `/v3/projects/e903acece5ae4712953c2923906051d6` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:21.634262 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e903acece5ae4712953c2923906051d6)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:21.636561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:21.705046 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e903acece5ae4712953c2923906051d6', 'request_id': 'req-6ad2e003-cde7-41cb-9829-169a6db36ffe'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.713560 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e903acece5ae4712953c2923906051d6', 'request_id': 'req-6ad2e003-cde7-41cb-9829-169a6db36ffe'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.726330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e903acece5ae4712953c2923906051d6', 'request_id': 'req-6ad2e003-cde7-41cb-9829-169a6db36ffe'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.744749 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] The token cache is being invalidate because project e903acece5ae4712953c2923906051d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:06:21.745451 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.746008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:06:21.747883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1351/2689] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:06:21 2021] DELETE /identity/v3/projects/e903acece5ae4712953c2923906051d6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:06:32.460468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912d60-2b64-474d-8aa7-ba9043795b60 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:32.461037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912d60-2b64-474d-8aa7-ba9043795b60 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:32.461037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912d60-2b64-474d-8aa7-ba9043795b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:32.486505 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-99912d60-2b64-474d-8aa7-ba9043795b60 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:06:32.487698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-99912d60-2b64-474d-8aa7-ba9043795b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:32.558623 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1339/2690] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 15:06:32 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:06:32.609945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:32.611393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:32.690123 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2e003-cde7-41cb-9829-169a6db36ffe admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:32.695556 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4938c-be1c-4ff2-96f7-93c8d62f4cec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:32.696158 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4938c-be1c-4ff2-96f7-93c8d62f4cec service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:32.696421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4938c-be1c-4ff2-96f7-93c8d62f4cec service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:32.696703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4938c-be1c-4ff2-96f7-93c8d62f4cec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:32.705956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4938c-be1c-4ff2-96f7-93c8d62f4cec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:32.707537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4938c-be1c-4ff2-96f7-93c8d62f4cec service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:32.716033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1352/2691] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:06:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:06:50.440625 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e7bd9-9f34-4ecf-b0b9-2c9fad9da6e8 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:50.441119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e7bd9-9f34-4ecf-b0b9-2c9fad9da6e8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:50.441218 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e7bd9-9f34-4ecf-b0b9-2c9fad9da6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:50.462656 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-5c9e7bd9-9f34-4ecf-b0b9-2c9fad9da6e8 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:06:50.463803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5c9e7bd9-9f34-4ecf-b0b9-2c9fad9da6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:50.471169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1340/2692] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 15:06:50 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:06:50.485034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4938c-be1c-4ff2-96f7-93c8d62f4cec service swift] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:50.495449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4938c-be1c-4ff2-96f7-93c8d62f4cec service swift] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:50.500161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baea46-5b6c-4f36-9a3d-4bc93550198b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:50.500729 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baea46-5b6c-4f36-9a3d-4bc93550198b service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:50.501015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baea46-5b6c-4f36-9a3d-4bc93550198b service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:50.501294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baea46-5b6c-4f36-9a3d-4bc93550198b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:50.509541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baea46-5b6c-4f36-9a3d-4bc93550198b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:50.511153 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baea46-5b6c-4f36-9a3d-4bc93550198b service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:50.519255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1353/2693] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:06:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:06:58.008209 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e7bd9-9f34-4ecf-b0b9-2c9fad9da6e8 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:06:58.010271 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5c9e7bd9-9f34-4ecf-b0b9-2c9fad9da6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:58.095210 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e7bd9-9f34-4ecf-b0b9-2c9fad9da6e8 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:06:58.101073 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:06:58.101892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:06:58.102185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:06:58.102501 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:06:58.104283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:06:58.171153 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:06:58.173062 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:06:58.183007 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1341/2694] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:06:58 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:07:08.350091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94fc6-aaad-43db-b8ac-31e123a25de7 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:07:08.350668 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94fc6-aaad-43db-b8ac-31e123a25de7 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:07:08.350780 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94fc6-aaad-43db-b8ac-31e123a25de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:07:08.374545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-67c94fc6-aaad-43db-b8ac-31e123a25de7 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:07:08.376070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-67c94fc6-aaad-43db-b8ac-31e123a25de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:08.384027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1354/2695] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 25 15:07:08 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:07:08.397011 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:07:08.408588 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545e584-2860-4300-b972-6eccfcb90256 service nova] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:07:08.413454 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baabad2-eb4f-4fce-946d-1972fcee308d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:07:08.414031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baabad2-eb4f-4fce-946d-1972fcee308d service swift] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:07:08.414319 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baabad2-eb4f-4fce-946d-1972fcee308d service swift] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:07:08.414633 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baabad2-eb4f-4fce-946d-1972fcee308d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:07:08.423086 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baabad2-eb4f-4fce-946d-1972fcee308d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:07:08.424636 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baabad2-eb4f-4fce-946d-1972fcee308d service swift] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:07:08.432517 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1342/2696] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:07:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:07:43.968833 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c94fc6-aaad-43db-b8ac-31e123a25de7 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:07:43.970311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-67c94fc6-aaad-43db-b8ac-31e123a25de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:44.036489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c94fc6-aaad-43db-b8ac-31e123a25de7 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:07:44.040214 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:07:44.040796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:07:44.041080 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:07:44.041357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:07:44.043075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:44.056327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:07:44.057737 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:07:44.068698 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1355/2697] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:07:43 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:07:45.320861 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baabad2-eb4f-4fce-946d-1972fcee308d service swift] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:07:45.331058 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baabad2-eb4f-4fce-946d-1972fcee308d service swift] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:07:45.334961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:07:45.335537 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:07:45.335828 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:07:45.336113 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:07:45.337816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:45.353552 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:07:45.355077 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:07:45.366825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1343/2698] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:07:45 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:07:50.852902 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:07:50.854388 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:50.922949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760914f4-5a12-4892-94cb-958369dbd4fc service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:07:50.926493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30172d74-5095-4acd-8b1b-1173797bebf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:07:50.927138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172d74-5095-4acd-8b1b-1173797bebf5 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:07:50.927428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172d74-5095-4acd-8b1b-1173797bebf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:07:50.927705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172d74-5095-4acd-8b1b-1173797bebf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:07:50.929444 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-30172d74-5095-4acd-8b1b-1173797bebf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:51.004164 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30172d74-5095-4acd-8b1b-1173797bebf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:07:51.005803 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30172d74-5095-4acd-8b1b-1173797bebf5 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:07:51.016026 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1356/2699] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:07:50 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:07:56.000377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:07:56.002678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:56.014202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb98030-ac39-483f-93ac-da6a1f586133 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:07:56.018863 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:07:56.019489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:07:56.019963 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:07:56.020299 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:07:56.022029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:56.108657 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:07:56.110910 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:07:56.121213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1344/2700] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:07:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:07:59.455441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf3092-a9b7-4f40-9be2-d962e7e074bc None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:07:59.455881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf3092-a9b7-4f40-9be2-d962e7e074bc None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:07:59.456034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf3092-a9b7-4f40-9be2-d962e7e074bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:07:59.482428 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-a2bf3092-a9b7-4f40-9be2-d962e7e074bc None None] MFA Rules not processed for user `8b6c5ce8a6e342b492f56c29d5f8b473`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:07:59.483595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a2bf3092-a9b7-4f40-9be2-d962e7e074bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:07:59.491121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1357/2701] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:07:59 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:08:00.736979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:00.737970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:00.843587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f635-bedd-4527-8cd7-6fea1e25ba18 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:00.848664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:00.849264 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:00.849622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:00.849922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:00.852513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:00.866820 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:00.868437 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:00.879376 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1345/2702] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:00 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:01.000679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf3092-a9b7-4f40-9be2-d962e7e074bc None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:01.003234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-a2bf3092-a9b7-4f40-9be2-d962e7e074bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:01.029987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf3092-a9b7-4f40-9be2-d962e7e074bc None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:01.039602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:01.041085 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:01.041824 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:01.042746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:01.045903 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:01.068870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:01.072961 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:01.092885 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1358/2703] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:00 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:01.582356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:01.583902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:01.597746 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8d7c0-55fa-4a9a-82fa-8c8275549b48 service placement] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:01.603872 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:01.604759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:01.605120 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:01.605493 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] PATH_INFO: `/v3/users/dee892a81cba413da63a4bbf1573fa94` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:01.606748 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee892a81cba413da63a4bbf1573fa94)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:01.608750 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:01.667631 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee892a81cba413da63a4bbf1573fa94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:01.680147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee892a81cba413da63a4bbf1573fa94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:01.681098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee892a81cba413da63a4bbf1573fa94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:01.681701 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee892a81cba413da63a4bbf1573fa94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:01.691418 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-dec1c1d1-f63a-4233-9a37-29d3b5d1faf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee892a81cba413da63a4bbf1573fa94'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:01.711941 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1346/2704] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:01 2021] DELETE /identity/v3/users/dee892a81cba413da63a4bbf1573fa94 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:01.972170 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:01.990433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83c4fb-3856-4ec2-acf1-5f35fe2675f7 service placement] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:02.058542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:02.059343 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.059633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.059917 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] PATH_INFO: `/v3/projects/642447a5062244b2a248e9c27858419a` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.061018 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642447a5062244b2a248e9c27858419a)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:02.063646 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:02.112093 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642447a5062244b2a248e9c27858419a', 'request_id': 'req-b139ce46-7875-4371-bdcc-c33f98a5f305'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:02.117493 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642447a5062244b2a248e9c27858419a', 'request_id': 'req-b139ce46-7875-4371-bdcc-c33f98a5f305'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:02.125827 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642447a5062244b2a248e9c27858419a', 'request_id': 'req-b139ce46-7875-4371-bdcc-c33f98a5f305'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:02.144455 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] The token cache is being invalidate because project 642447a5062244b2a248e9c27858419a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:02.144741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:02.145452 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b139ce46-7875-4371-bdcc-c33f98a5f305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:02.147124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1359/2705] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:01 2021] DELETE /identity/v3/projects/642447a5062244b2a248e9c27858419a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:02.153185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b02e-778d-464e-a441-11328489724b None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.153727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b02e-778d-464e-a441-11328489724b None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.153904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b02e-778d-464e-a441-11328489724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.178056 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-26c7b02e-778d-464e-a441-11328489724b None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:02.179256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-26c7b02e-778d-464e-a441-11328489724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:02.246772 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1347/2706] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:02.255396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa722-8fa8-4d74-a917-b96b2b0c8233 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.255684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa722-8fa8-4d74-a917-b96b2b0c8233 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.256162 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa722-8fa8-4d74-a917-b96b2b0c8233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.278502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-8ccaa722-8fa8-4d74-a917-b96b2b0c8233 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:02.279666 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-8ccaa722-8fa8-4d74-a917-b96b2b0c8233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:02.287213 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1360/2707] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:02.291639 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7b02e-778d-464e-a441-11328489724b None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:02.304873 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7b02e-778d-464e-a441-11328489724b None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:02.312476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:02.313393 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.313678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.313960 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.314697 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:08:02.314998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:02.316595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:02.335550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1348/2708] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:08:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 15:08:02.340977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaa722-8fa8-4d74-a917-b96b2b0c8233 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:02.355256 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaa722-8fa8-4d74-a917-b96b2b0c8233 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:02.363192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feda3f-cb7b-424b-abf2-a9aa37a2a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:02.364169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feda3f-cb7b-424b-abf2-a9aa37a2a8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.364478 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feda3f-cb7b-424b-abf2-a9aa37a2a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.364792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feda3f-cb7b-424b-abf2-a9aa37a2a8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.365435 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46feda3f-cb7b-424b-abf2-a9aa37a2a8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:02.367395 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46feda3f-cb7b-424b-abf2-a9aa37a2a8f1 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:02.399693 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1361/2709] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:02 2021] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:02.406208 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:02.417996 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e96c-5cd5-497b-a47d-1deb4627e620 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:02.488575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949cced-11fe-4f5c-8f4a-7a7473faf25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:02.489183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949cced-11fe-4f5c-8f4a-7a7473faf25f admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.489477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949cced-11fe-4f5c-8f4a-7a7473faf25f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.489757 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949cced-11fe-4f5c-8f4a-7a7473faf25f admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.490394 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949cced-11fe-4f5c-8f4a-7a7473faf25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:02.492317 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949cced-11fe-4f5c-8f4a-7a7473faf25f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:02.513435 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1349/2710] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:02 2021] POST /identity/v3/users => generated 305 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:08:02.517723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feda3f-cb7b-424b-abf2-a9aa37a2a8f1 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:02.540464 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feda3f-cb7b-424b-abf2-a9aa37a2a8f1 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:02.544978 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ccb4a-faa7-4138-9b7d-c105889ba822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:02.545577 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ccb4a-faa7-4138-9b7d-c105889ba822 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.545862 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ccb4a-faa7-4138-9b7d-c105889ba822 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.546141 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ccb4a-faa7-4138-9b7d-c105889ba822 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.547543 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ccb4a-faa7-4138-9b7d-c105889ba822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:02.549130 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ccb4a-faa7-4138-9b7d-c105889ba822 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:02.565202 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1362/2711] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:02.566349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949cced-11fe-4f5c-8f4a-7a7473faf25f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:02.576348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949cced-11fe-4f5c-8f4a-7a7473faf25f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:02.581496 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a362d-5ccc-4297-8e36-5994e2dbf267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:02.582098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a362d-5ccc-4297-8e36-5994e2dbf267 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.582545 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a362d-5ccc-4297-8e36-5994e2dbf267 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.582879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a362d-5ccc-4297-8e36-5994e2dbf267 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.583581 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a362d-5ccc-4297-8e36-5994e2dbf267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:02.585169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a362d-5ccc-4297-8e36-5994e2dbf267 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:02.599535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1350/2712] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:08:02.600833 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ccb4a-faa7-4138-9b7d-c105889ba822 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:02.612416 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ccb4a-faa7-4138-9b7d-c105889ba822 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:02.617192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f22a72-d484-45ee-9272-629741dda3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:02.617816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f22a72-d484-45ee-9272-629741dda3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.618781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f22a72-d484-45ee-9272-629741dda3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.618781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f22a72-d484-45ee-9272-629741dda3b7 admin admin] PATH_INFO: `/v3/projects/81a1f102cdbf448181022fcd8720935d/users/4997537f2fc248188ada836ca35a7c32/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.640813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f22a72-d484-45ee-9272-629741dda3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a1f102cdbf448181022fcd8720935d, user_id=4997537f2fc248188ada836ca35a7c32, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:02.643594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f22a72-d484-45ee-9272-629741dda3b7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:02.658114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1363/2713] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:02 2021] PUT /identity/v3/projects/81a1f102cdbf448181022fcd8720935d/users/4997537f2fc248188ada836ca35a7c32/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:02.668826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfb950-6543-418b-8cc1-f7d0d926e8f1 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.669135 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfb950-6543-418b-8cc1-f7d0d926e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.669467 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfb950-6543-418b-8cc1-f7d0d926e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.708228 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-7fdfb950-6543-418b-8cc1-f7d0d926e8f1 None None] MFA Rules not processed for user `4997537f2fc248188ada836ca35a7c32`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:02.709420 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-7fdfb950-6543-418b-8cc1-f7d0d926e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:02.785106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1351/2714] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:02 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:08:02.789539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f22a72-d484-45ee-9272-629741dda3b7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:02.874097 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f22a72-d484-45ee-9272-629741dda3b7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:02.878679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e678f7-e1ae-4693-a123-11b3fcbffb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:02.879280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e678f7-e1ae-4693-a123-11b3fcbffb71 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:02.879568 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e678f7-e1ae-4693-a123-11b3fcbffb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:02.879850 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e678f7-e1ae-4693-a123-11b3fcbffb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:02.880495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e678f7-e1ae-4693-a123-11b3fcbffb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:02.882396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e678f7-e1ae-4693-a123-11b3fcbffb71 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:02.915284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1364/2715] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:02 2021] POST /identity/v3/projects => generated 409 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:02.916575 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfb950-6543-418b-8cc1-f7d0d926e8f1 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:02.927305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfb950-6543-418b-8cc1-f7d0d926e8f1 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:03.001955 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239043-0c73-4a6b-aed8-f26bd7771039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:03.002704 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239043-0c73-4a6b-aed8-f26bd7771039 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.003059 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239043-0c73-4a6b-aed8-f26bd7771039 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.003424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239043-0c73-4a6b-aed8-f26bd7771039 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.004146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22239043-0c73-4a6b-aed8-f26bd7771039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:03.006171 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22239043-0c73-4a6b-aed8-f26bd7771039 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:03.036920 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1352/2716] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:02 2021] POST /identity/v3/users => generated 311 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:03.039955 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e678f7-e1ae-4693-a123-11b3fcbffb71 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:03.052307 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e678f7-e1ae-4693-a123-11b3fcbffb71 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:03.057779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a76674-3b49-414a-8aaf-ed3175d6f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:03.058530 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76674-3b49-414a-8aaf-ed3175d6f392 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.058776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76674-3b49-414a-8aaf-ed3175d6f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.059355 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76674-3b49-414a-8aaf-ed3175d6f392 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.059808 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a76674-3b49-414a-8aaf-ed3175d6f392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:03.061439 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a76674-3b49-414a-8aaf-ed3175d6f392 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:03.075070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1365/2717] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:03.083898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239043-0c73-4a6b-aed8-f26bd7771039 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:03.099831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239043-0c73-4a6b-aed8-f26bd7771039 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:03.106974 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0d2bf-de79-4b08-b2fb-6d65edd17d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:03.107711 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0d2bf-de79-4b08-b2fb-6d65edd17d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.108680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0d2bf-de79-4b08-b2fb-6d65edd17d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.108680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0d2bf-de79-4b08-b2fb-6d65edd17d2c admin admin] PATH_INFO: `/v3/projects/3cf3ab27d160450d8a57cd4ebb0ab3da/users/baf72138e2e144eaa3c5008501367fd8/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.130559 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0d2bf-de79-4b08-b2fb-6d65edd17d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf3ab27d160450d8a57cd4ebb0ab3da, user_id=baf72138e2e144eaa3c5008501367fd8, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:03.133385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0d2bf-de79-4b08-b2fb-6d65edd17d2c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:03.149930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1353/2718] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:03 2021] PUT /identity/v3/projects/3cf3ab27d160450d8a57cd4ebb0ab3da/users/baf72138e2e144eaa3c5008501367fd8/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:03.154127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a76674-3b49-414a-8aaf-ed3175d6f392 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:03.164121 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a76674-3b49-414a-8aaf-ed3175d6f392 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:03.243165 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec31b05-d7b4-4c91-83da-9857d51724bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:03.243771 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31b05-d7b4-4c91-83da-9857d51724bb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.244065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31b05-d7b4-4c91-83da-9857d51724bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.244461 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31b05-d7b4-4c91-83da-9857d51724bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.245311 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec31b05-d7b4-4c91-83da-9857d51724bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:03.247172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec31b05-d7b4-4c91-83da-9857d51724bb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:03.260971 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1366/2719] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:08:03.265867 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0d2bf-de79-4b08-b2fb-6d65edd17d2c admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:03.276718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0d2bf-de79-4b08-b2fb-6d65edd17d2c admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:03.281443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:03.282282 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.282606 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.282900 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] PATH_INFO: `/v3/projects/3cf3ab27d160450d8a57cd4ebb0ab3da/users/baf72138e2e144eaa3c5008501367fd8/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.284766 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf3ab27d160450d8a57cd4ebb0ab3da, user_id=baf72138e2e144eaa3c5008501367fd8, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:03.287637 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:03.310019 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1354/2720] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:03 2021] PUT /identity/v3/projects/3cf3ab27d160450d8a57cd4ebb0ab3da/users/baf72138e2e144eaa3c5008501367fd8/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:03.315500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e1a57-bd74-42a7-b1dd-edeb4148ed5a None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.315823 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e1a57-bd74-42a7-b1dd-edeb4148ed5a None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.316112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e1a57-bd74-42a7-b1dd-edeb4148ed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.361114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-951e1a57-bd74-42a7-b1dd-edeb4148ed5a None None] MFA Rules not processed for user `baf72138e2e144eaa3c5008501367fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:03.362342 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-951e1a57-bd74-42a7-b1dd-edeb4148ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:03.475633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1367/2721] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:03 2021] POST /identity/v3/auth/tokens => generated 3783 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:03.486081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:03.488361 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:03.536330 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e1a57-bd74-42a7-b1dd-edeb4148ed5a None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:03.537806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-951e1a57-bd74-42a7-b1dd-edeb4148ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:03.566377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143ceee-4fb7-4f24-9dcf-68cc22a87570 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:03.571169 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fa58-8817-4f7a-a80b-a3cc47bdd094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:03.572220 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fa58-8817-4f7a-a80b-a3cc47bdd094 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.572702 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fa58-8817-4f7a-a80b-a3cc47bdd094 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.573118 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fa58-8817-4f7a-a80b-a3cc47bdd094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.585815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10fa58-8817-4f7a-a80b-a3cc47bdd094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:03.588337 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10fa58-8817-4f7a-a80b-a3cc47bdd094 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:03.601482 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1355/2722] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:03 2021] GET /identity/v3/auth/tokens => generated 3783 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:03.610345 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e1a57-bd74-42a7-b1dd-edeb4148ed5a None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:03.614326 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:03.615033 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.615528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.616042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.617930 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:03.628739 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:03.630459 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:03.642529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1368/2723] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:03 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:08:03.788664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fa58-8817-4f7a-a80b-a3cc47bdd094 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:03.797981 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fa58-8817-4f7a-a80b-a3cc47bdd094 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:03.801568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a909-8f9d-4efa-81f3-179b35c03116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:03.802492 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a909-8f9d-4efa-81f3-179b35c03116 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:03.802880 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a909-8f9d-4efa-81f3-179b35c03116 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:03.803232 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a909-8f9d-4efa-81f3-179b35c03116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:03.873432 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a909-8f9d-4efa-81f3-179b35c03116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:03.875727 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a909-8f9d-4efa-81f3-179b35c03116 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:03.884782 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1356/2724] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:03 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:04.776320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:04.778599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:04.880138 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5440-a727-400a-bb3e-8d0dc24765d6 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:04.885767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a528590-da5a-4755-9fcc-85619e68681f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:04.886506 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a528590-da5a-4755-9fcc-85619e68681f service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:04.886894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a528590-da5a-4755-9fcc-85619e68681f service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:04.887241 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a528590-da5a-4755-9fcc-85619e68681f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:04.889169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-7a528590-da5a-4755-9fcc-85619e68681f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:04.902797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a528590-da5a-4755-9fcc-85619e68681f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:04.904603 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a528590-da5a-4755-9fcc-85619e68681f service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:04.915629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1369/2725] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:04 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:12.919780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a909-8f9d-4efa-81f3-179b35c03116 service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:13.004234 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a909-8f9d-4efa-81f3-179b35c03116 service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:13.008797 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:13.009591 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:13.009917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:13.010164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] PATH_INFO: `/v3/users/4997537f2fc248188ada836ca35a7c32` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:13.011340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4997537f2fc248188ada836ca35a7c32)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:13.013249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:13.068296 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4997537f2fc248188ada836ca35a7c32'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.075015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4997537f2fc248188ada836ca35a7c32'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.075612 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4997537f2fc248188ada836ca35a7c32'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.076216 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4997537f2fc248188ada836ca35a7c32'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.084810 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4997537f2fc248188ada836ca35a7c32'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.102294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1357/2726] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:12 2021] DELETE /identity/v3/users/4997537f2fc248188ada836ca35a7c32 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:13.106801 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c33c10-f093-4f94-bf32-45cfa33ddf05 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:13.107276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c33c10-f093-4f94-bf32-45cfa33ddf05 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:13.107374 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c33c10-f093-4f94-bf32-45cfa33ddf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:13.130034 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b1c33c10-f093-4f94-bf32-45cfa33ddf05 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:13.131236 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b1c33c10-f093-4f94-bf32-45cfa33ddf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:13.195495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1370/2727] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:08:13.206378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:13.207785 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:13.271140 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d3f80-6843-460f-b8b8-571d0a27373b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:13.274634 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490b07f-f12b-4cc8-a541-e88c7179fc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:13.275217 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b07f-f12b-4cc8-a541-e88c7179fc0f service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:13.275506 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b07f-f12b-4cc8-a541-e88c7179fc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:13.275791 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b07f-f12b-4cc8-a541-e88c7179fc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:13.284673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490b07f-f12b-4cc8-a541-e88c7179fc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:13.286110 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490b07f-f12b-4cc8-a541-e88c7179fc0f service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:13.295822 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1358/2728] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:13.662304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c33c10-f093-4f94-bf32-45cfa33ddf05 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:13.663873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b1c33c10-f093-4f94-bf32-45cfa33ddf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:13.676192 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c33c10-f093-4f94-bf32-45cfa33ddf05 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:13.681881 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:13.682692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:13.683117 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:13.683954 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] PATH_INFO: `/v3/projects/81a1f102cdbf448181022fcd8720935d` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:13.685359 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a1f102cdbf448181022fcd8720935d)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:13.687956 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:13.739390 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a1f102cdbf448181022fcd8720935d', 'request_id': 'req-2be63852-60ca-434a-af37-7350d6387fd7'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.744431 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a1f102cdbf448181022fcd8720935d', 'request_id': 'req-2be63852-60ca-434a-af37-7350d6387fd7'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.751845 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a1f102cdbf448181022fcd8720935d', 'request_id': 'req-2be63852-60ca-434a-af37-7350d6387fd7'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.768180 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] The token cache is being invalidate because project 81a1f102cdbf448181022fcd8720935d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:13.768495 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.769136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.770694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1371/2729] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:13 2021] DELETE /identity/v3/projects/81a1f102cdbf448181022fcd8720935d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:13.774622 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490b07f-f12b-4cc8-a541-e88c7179fc0f service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:13.784589 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490b07f-f12b-4cc8-a541-e88c7179fc0f service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:13.853372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:13.854195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:13.854519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:13.854804 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] PATH_INFO: `/v3/users/baf72138e2e144eaa3c5008501367fd8` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:13.855961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf72138e2e144eaa3c5008501367fd8)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:13.857866 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:13.907350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf72138e2e144eaa3c5008501367fd8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.914345 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf72138e2e144eaa3c5008501367fd8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.915034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf72138e2e144eaa3c5008501367fd8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.915661 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf72138e2e144eaa3c5008501367fd8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.923949 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-2899f1f1-868d-489d-9239-529f9116ed36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf72138e2e144eaa3c5008501367fd8'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:13.940378 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1359/2730] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:13 2021] DELETE /identity/v3/users/baf72138e2e144eaa3c5008501367fd8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:14.317512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:14.319534 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:14.335393 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63852-60ca-434a-af37-7350d6387fd7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:14.416651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:14.417806 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:14.418211 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:14.418641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] PATH_INFO: `/v3/projects/3cf3ab27d160450d8a57cd4ebb0ab3da` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:14.420149 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf3ab27d160450d8a57cd4ebb0ab3da)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:14.423633 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:14.494135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf3ab27d160450d8a57cd4ebb0ab3da', 'request_id': 'req-22413ca6-c616-491e-a80a-42be4c972a43'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:14.500487 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf3ab27d160450d8a57cd4ebb0ab3da', 'request_id': 'req-22413ca6-c616-491e-a80a-42be4c972a43'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:14.508838 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf3ab27d160450d8a57cd4ebb0ab3da', 'request_id': 'req-22413ca6-c616-491e-a80a-42be4c972a43'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:14.533515 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] The token cache is being invalidate because project 3cf3ab27d160450d8a57cd4ebb0ab3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:14.533888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:14.534829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22413ca6-c616-491e-a80a-42be4c972a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:14.536765 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1372/2731] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:14 2021] DELETE /identity/v3/projects/3cf3ab27d160450d8a57cd4ebb0ab3da => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:14.543649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb9d53-c4e0-47c1-a0c5-f6d139c85108 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:14.543947 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb9d53-c4e0-47c1-a0c5-f6d139c85108 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:14.544226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb9d53-c4e0-47c1-a0c5-f6d139c85108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:14.567715 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6fdb9d53-c4e0-47c1-a0c5-f6d139c85108 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:14.569273 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6fdb9d53-c4e0-47c1-a0c5-f6d139c85108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:14.634388 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1360/2732] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:14.642551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acec04-73a8-46d8-98dd-5c2e844aefb0 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:14.643172 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acec04-73a8-46d8-98dd-5c2e844aefb0 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:14.643647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acec04-73a8-46d8-98dd-5c2e844aefb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:14.673951 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-c8acec04-73a8-46d8-98dd-5c2e844aefb0 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:14.675719 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-c8acec04-73a8-46d8-98dd-5c2e844aefb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:14.684195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1373/2733] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:08:14.688468 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb9d53-c4e0-47c1-a0c5-f6d139c85108 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:14.698706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb9d53-c4e0-47c1-a0c5-f6d139c85108 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:14.703671 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:14.704587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:14.704927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:14.705187 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:14.705882 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:08:14.706183 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:14.707816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:14.722937 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1361/2734] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:08:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:08:14.727344 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acec04-73a8-46d8-98dd-5c2e844aefb0 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:14.737792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acec04-73a8-46d8-98dd-5c2e844aefb0 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:14.742545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105fa7-8c57-49a1-8e8d-0e0bfa1c42be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:14.743144 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105fa7-8c57-49a1-8e8d-0e0bfa1c42be admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:14.743429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105fa7-8c57-49a1-8e8d-0e0bfa1c42be admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:14.743709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105fa7-8c57-49a1-8e8d-0e0bfa1c42be admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:14.744354 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105fa7-8c57-49a1-8e8d-0e0bfa1c42be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:14.746265 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105fa7-8c57-49a1-8e8d-0e0bfa1c42be admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:14.778874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1374/2735] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:14 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:14.783592 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:14.793340 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637404a-719c-49cb-a5c5-03ced9117469 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:14.862901 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d575d-df3a-4341-9045-621d61f9f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:14.863527 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d575d-df3a-4341-9045-621d61f9f13d admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:14.863817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d575d-df3a-4341-9045-621d61f9f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:14.864179 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d575d-df3a-4341-9045-621d61f9f13d admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:14.864807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d575d-df3a-4341-9045-621d61f9f13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:14.866745 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d575d-df3a-4341-9045-621d61f9f13d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:14.890631 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1362/2736] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:14 2021] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:14.895802 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105fa7-8c57-49a1-8e8d-0e0bfa1c42be admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:14.911873 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105fa7-8c57-49a1-8e8d-0e0bfa1c42be admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:14.918304 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bdfe-b8f5-4214-986c-f085300ea174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:14.920841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bdfe-b8f5-4214-986c-f085300ea174 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:14.920841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bdfe-b8f5-4214-986c-f085300ea174 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:14.920841 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bdfe-b8f5-4214-986c-f085300ea174 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:14.921239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983bdfe-b8f5-4214-986c-f085300ea174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:14.923796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983bdfe-b8f5-4214-986c-f085300ea174 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:14.941475 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1375/2737] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:14 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:14.946548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d575d-df3a-4341-9045-621d61f9f13d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:14.964224 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d575d-df3a-4341-9045-621d61f9f13d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:14.970348 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0694f1-4d14-42e9-81a4-485363f71d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:14.970990 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0694f1-4d14-42e9-81a4-485363f71d43 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:14.971285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0694f1-4d14-42e9-81a4-485363f71d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:14.971567 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0694f1-4d14-42e9-81a4-485363f71d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:14.972398 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0694f1-4d14-42e9-81a4-485363f71d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:14.973921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0694f1-4d14-42e9-81a4-485363f71d43 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:14.987494 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1363/2738] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:14 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:14.992257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bdfe-b8f5-4214-986c-f085300ea174 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:15.002738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bdfe-b8f5-4214-986c-f085300ea174 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:15.007915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608473d-055e-408b-bba4-04270ee3506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:15.008766 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608473d-055e-408b-bba4-04270ee3506b admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.009179 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608473d-055e-408b-bba4-04270ee3506b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.009402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608473d-055e-408b-bba4-04270ee3506b admin admin] PATH_INFO: `/v3/projects/7b8c5f875f624a08b7526792fb83ee6a/users/a90422a8684f4bd0bc5ca210263359dd/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.032789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608473d-055e-408b-bba4-04270ee3506b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8c5f875f624a08b7526792fb83ee6a, user_id=a90422a8684f4bd0bc5ca210263359dd, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:15.035805 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608473d-055e-408b-bba4-04270ee3506b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:15.050871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1376/2739] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:14 2021] PUT /identity/v3/projects/7b8c5f875f624a08b7526792fb83ee6a/users/a90422a8684f4bd0bc5ca210263359dd/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:15.061373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df53a6-488f-4451-812f-d5d85a428127 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.061838 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df53a6-488f-4451-812f-d5d85a428127 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.062215 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df53a6-488f-4451-812f-d5d85a428127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.131728 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d7df53a6-488f-4451-812f-d5d85a428127 None None] MFA Rules not processed for user `a90422a8684f4bd0bc5ca210263359dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:15.133210 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d7df53a6-488f-4451-812f-d5d85a428127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:15.233151 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1364/2740] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:15 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:15.237919 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608473d-055e-408b-bba4-04270ee3506b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:15.315968 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608473d-055e-408b-bba4-04270ee3506b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:15.320421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c2f48-d69f-451a-9dd3-9c19d820e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:15.321221 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2f48-d69f-451a-9dd3-9c19d820e756 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.321384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2f48-d69f-451a-9dd3-9c19d820e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.321551 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2f48-d69f-451a-9dd3-9c19d820e756 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.322215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c2f48-d69f-451a-9dd3-9c19d820e756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:15.324124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c2f48-d69f-451a-9dd3-9c19d820e756 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:15.355896 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1377/2741] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:15 2021] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:15.360164 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df53a6-488f-4451-812f-d5d85a428127 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:15.371513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df53a6-488f-4451-812f-d5d85a428127 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:15.451550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05460a7-c75a-4522-8412-043dea6974da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:15.452182 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05460a7-c75a-4522-8412-043dea6974da admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.452992 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05460a7-c75a-4522-8412-043dea6974da admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.453274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05460a7-c75a-4522-8412-043dea6974da admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.453923 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05460a7-c75a-4522-8412-043dea6974da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:15.455904 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05460a7-c75a-4522-8412-043dea6974da admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:15.481703 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1365/2742] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:15 2021] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:08:15.483031 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c2f48-d69f-451a-9dd3-9c19d820e756 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:15.494266 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c2f48-d69f-451a-9dd3-9c19d820e756 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:15.500147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396465e-50ad-4449-a8a7-d382a601bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:15.500754 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396465e-50ad-4449-a8a7-d382a601bfea admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.501044 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396465e-50ad-4449-a8a7-d382a601bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.501327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396465e-50ad-4449-a8a7-d382a601bfea admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.502036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396465e-50ad-4449-a8a7-d382a601bfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:15.503705 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396465e-50ad-4449-a8a7-d382a601bfea admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:15.514992 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1378/2743] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:15.519597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05460a7-c75a-4522-8412-043dea6974da admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:15.533830 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05460a7-c75a-4522-8412-043dea6974da admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:15.539870 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ac8a-1abe-402a-a614-b64afda6dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:15.541150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ac8a-1abe-402a-a614-b64afda6dd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.541561 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ac8a-1abe-402a-a614-b64afda6dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.541961 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ac8a-1abe-402a-a614-b64afda6dd5b admin admin] PATH_INFO: `/v3/projects/aa60f1a3d4934227833310d1268d3d82/users/0e22bc0d5db54013af67a4bc272e8e96/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.571970 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475ac8a-1abe-402a-a614-b64afda6dd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa60f1a3d4934227833310d1268d3d82, user_id=0e22bc0d5db54013af67a4bc272e8e96, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:15.576023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475ac8a-1abe-402a-a614-b64afda6dd5b admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:15.593892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1366/2744] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:15 2021] PUT /identity/v3/projects/aa60f1a3d4934227833310d1268d3d82/users/0e22bc0d5db54013af67a4bc272e8e96/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:15.598093 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396465e-50ad-4449-a8a7-d382a601bfea admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:15.608047 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396465e-50ad-4449-a8a7-d382a601bfea admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:15.673638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4cf32-008c-46ff-9570-82f1fddf00db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:15.674233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cf32-008c-46ff-9570-82f1fddf00db admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.674605 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cf32-008c-46ff-9570-82f1fddf00db admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.674880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cf32-008c-46ff-9570-82f1fddf00db admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.675562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4cf32-008c-46ff-9570-82f1fddf00db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:15.677151 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4cf32-008c-46ff-9570-82f1fddf00db admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:15.688558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1379/2745] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:15 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:08:15.693184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ac8a-1abe-402a-a614-b64afda6dd5b admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:15.704585 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ac8a-1abe-402a-a614-b64afda6dd5b admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:15.709158 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:15.709982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.710269 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.710585 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] PATH_INFO: `/v3/projects/aa60f1a3d4934227833310d1268d3d82/users/0e22bc0d5db54013af67a4bc272e8e96/roles/98f77a1006404111a8be8686551c8675` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.712403 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa60f1a3d4934227833310d1268d3d82, user_id=0e22bc0d5db54013af67a4bc272e8e96, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:15.715084 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:15.728080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1367/2746] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:15 2021] PUT /identity/v3/projects/aa60f1a3d4934227833310d1268d3d82/users/0e22bc0d5db54013af67a4bc272e8e96/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:15.741641 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730b3c6-99c9-4755-bd22-23f134d81071 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.741939 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730b3c6-99c9-4755-bd22-23f134d81071 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.742229 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730b3c6-99c9-4755-bd22-23f134d81071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.779594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-1730b3c6-99c9-4755-bd22-23f134d81071 None None] MFA Rules not processed for user `0e22bc0d5db54013af67a4bc272e8e96`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:15.780820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1730b3c6-99c9-4755-bd22-23f134d81071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:15.867030 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1380/2747] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:15 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:15.880675 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:15.882423 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:15.957045 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162398-456e-4e3e-b9e3-29f11e355ab4 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:15.960752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2db957-d0d3-4fcc-921e-b1236f5f2645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:15.961326 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2db957-d0d3-4fcc-921e-b1236f5f2645 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:15.961613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2db957-d0d3-4fcc-921e-b1236f5f2645 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:15.961892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2db957-d0d3-4fcc-921e-b1236f5f2645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:15.973247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2db957-d0d3-4fcc-921e-b1236f5f2645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:15.974706 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2db957-d0d3-4fcc-921e-b1236f5f2645 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:15.986879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1368/2748] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:15 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:16.597228 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730b3c6-99c9-4755-bd22-23f134d81071 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:16.685216 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730b3c6-99c9-4755-bd22-23f134d81071 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:16.689946 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:16.690781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:16.691232 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:16.691420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] PATH_INFO: `/v3/users/a90422a8684f4bd0bc5ca210263359dd` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:16.692512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90422a8684f4bd0bc5ca210263359dd)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:16.694420 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:16.743888 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90422a8684f4bd0bc5ca210263359dd'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:16.753139 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90422a8684f4bd0bc5ca210263359dd'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:16.753901 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90422a8684f4bd0bc5ca210263359dd'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:16.754612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90422a8684f4bd0bc5ca210263359dd'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:16.767547 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90422a8684f4bd0bc5ca210263359dd'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:16.788796 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1381/2749] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:16 2021] DELETE /identity/v3/users/a90422a8684f4bd0bc5ca210263359dd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:16.793166 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482f63-9a3c-4dc8-bf18-95f66607a574 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:16.793455 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482f63-9a3c-4dc8-bf18-95f66607a574 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:16.793732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482f63-9a3c-4dc8-bf18-95f66607a574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:16.818186 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-5d482f63-9a3c-4dc8-bf18-95f66607a574 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:16.819392 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5d482f63-9a3c-4dc8-bf18-95f66607a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:16.913354 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1369/2750] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:16.924945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:16.928912 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:17.017677 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8aedb4-9079-4c4a-9ebb-6bd1498f145c admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:17.021541 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0936a5-952c-417a-9a36-659d2f8fd46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:17.022215 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0936a5-952c-417a-9a36-659d2f8fd46d service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:17.022562 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0936a5-952c-417a-9a36-659d2f8fd46d service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:17.022848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0936a5-952c-417a-9a36-659d2f8fd46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:17.033182 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0936a5-952c-417a-9a36-659d2f8fd46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:17.034671 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0936a5-952c-417a-9a36-659d2f8fd46d service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:17.044685 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1382/2751] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:17.432374 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482f63-9a3c-4dc8-bf18-95f66607a574 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:17.433805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5d482f63-9a3c-4dc8-bf18-95f66607a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:17.445085 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482f63-9a3c-4dc8-bf18-95f66607a574 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:17.449831 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:17.450665 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:17.450951 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:17.451547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] PATH_INFO: `/v3/projects/7b8c5f875f624a08b7526792fb83ee6a` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:17.453265 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8c5f875f624a08b7526792fb83ee6a)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:17.455195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:17.509372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8c5f875f624a08b7526792fb83ee6a', 'request_id': 'req-6342b437-a488-4b0a-85cb-8707d7464550'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.514666 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8c5f875f624a08b7526792fb83ee6a', 'request_id': 'req-6342b437-a488-4b0a-85cb-8707d7464550'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.523877 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8c5f875f624a08b7526792fb83ee6a', 'request_id': 'req-6342b437-a488-4b0a-85cb-8707d7464550'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.541452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] The token cache is being invalidate because project 7b8c5f875f624a08b7526792fb83ee6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:17.541738 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.550489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.550489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1370/2752] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:17 2021] DELETE /identity/v3/projects/7b8c5f875f624a08b7526792fb83ee6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:17.557993 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0936a5-952c-417a-9a36-659d2f8fd46d service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:17.570717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0936a5-952c-417a-9a36-659d2f8fd46d service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:17.654132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:17.660709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:17.660709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:17.660709 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] PATH_INFO: `/v3/users/0e22bc0d5db54013af67a4bc272e8e96` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:17.662829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e22bc0d5db54013af67a4bc272e8e96)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:17.669318 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:17.737509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e22bc0d5db54013af67a4bc272e8e96'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.757334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e22bc0d5db54013af67a4bc272e8e96'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.758075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e22bc0d5db54013af67a4bc272e8e96'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.758733 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e22bc0d5db54013af67a4bc272e8e96'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.782708 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-831c46a5-407c-41fe-8ca8-a0e18b362703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e22bc0d5db54013af67a4bc272e8e96'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:17.797187 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1383/2753] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:17 2021] DELETE /identity/v3/users/0e22bc0d5db54013af67a4bc272e8e96 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:18.353777 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:18.355724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:18.370146 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b437-a488-4b0a-85cb-8707d7464550 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:18.441185 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:18.442080 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:18.442373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:18.442685 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] PATH_INFO: `/v3/projects/aa60f1a3d4934227833310d1268d3d82` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:18.443902 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa60f1a3d4934227833310d1268d3d82)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:18.445825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:18.500349 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa60f1a3d4934227833310d1268d3d82', 'request_id': 'req-99d58530-dd90-4f8c-8687-de50d91c0b38'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:18.505735 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa60f1a3d4934227833310d1268d3d82', 'request_id': 'req-99d58530-dd90-4f8c-8687-de50d91c0b38'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:18.514079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa60f1a3d4934227833310d1268d3d82', 'request_id': 'req-99d58530-dd90-4f8c-8687-de50d91c0b38'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:18.536057 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] The token cache is being invalidate because project aa60f1a3d4934227833310d1268d3d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:18.536332 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:18.537002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-99d58530-dd90-4f8c-8687-de50d91c0b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:18.538495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1371/2754] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:18 2021] DELETE /identity/v3/projects/aa60f1a3d4934227833310d1268d3d82 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:18.544645 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef612b-3f34-4200-9fcb-5ee74638aafb None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:18.544944 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef612b-3f34-4200-9fcb-5ee74638aafb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:18.545225 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef612b-3f34-4200-9fcb-5ee74638aafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:18.570254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-47ef612b-3f34-4200-9fcb-5ee74638aafb None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:18.571448 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-47ef612b-3f34-4200-9fcb-5ee74638aafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:18.652765 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1384/2755] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:18.660846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0539d3-23f3-4ca0-9677-6d7cb3ad9769 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:18.661286 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0539d3-23f3-4ca0-9677-6d7cb3ad9769 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:18.661590 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0539d3-23f3-4ca0-9677-6d7cb3ad9769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:18.688876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-ad0539d3-23f3-4ca0-9677-6d7cb3ad9769 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:18.690060 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-ad0539d3-23f3-4ca0-9677-6d7cb3ad9769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:18.698356 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1372/2756] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:08:18.703143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef612b-3f34-4200-9fcb-5ee74638aafb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:18.713951 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef612b-3f34-4200-9fcb-5ee74638aafb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:18.718933 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:18.719532 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:18.719820 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:18.720091 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:18.720799 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:08:18.721077 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:18.722681 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:18.736701 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1385/2757] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:08:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 15:08:18.741253 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0539d3-23f3-4ca0-9677-6d7cb3ad9769 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:18.751134 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0539d3-23f3-4ca0-9677-6d7cb3ad9769 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:18.755474 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efe983-4fa4-46e6-a29e-0791a2d08568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:18.756093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe983-4fa4-46e6-a29e-0791a2d08568 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:18.756385 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe983-4fa4-46e6-a29e-0791a2d08568 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:18.756663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe983-4fa4-46e6-a29e-0791a2d08568 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:18.757342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efe983-4fa4-46e6-a29e-0791a2d08568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:18.759341 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efe983-4fa4-46e6-a29e-0791a2d08568 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:18.899367 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1373/2758] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:18 2021] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:18.905809 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:18.922113 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8ec15-f598-42cc-ac01-f924503a0fdb admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:19.016147 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ac483-3ffd-4133-9dbf-17b0c6bafaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:19.016792 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ac483-3ffd-4133-9dbf-17b0c6bafaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:19.017079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ac483-3ffd-4133-9dbf-17b0c6bafaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:19.017356 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ac483-3ffd-4133-9dbf-17b0c6bafaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:19.018056 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ac483-3ffd-4133-9dbf-17b0c6bafaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:19.020012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ac483-3ffd-4133-9dbf-17b0c6bafaa9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:19.042114 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1386/2759] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:18 2021] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:19.047029 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efe983-4fa4-46e6-a29e-0791a2d08568 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:19.057909 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efe983-4fa4-46e6-a29e-0791a2d08568 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:19.064562 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7db18-733b-4c9d-bbc4-ee36c6ed28a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:19.065373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7db18-733b-4c9d-bbc4-ee36c6ed28a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:19.065752 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7db18-733b-4c9d-bbc4-ee36c6ed28a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:19.066261 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7db18-733b-4c9d-bbc4-ee36c6ed28a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:19.067148 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7db18-733b-4c9d-bbc4-ee36c6ed28a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:19.068800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7db18-733b-4c9d-bbc4-ee36c6ed28a0 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:19.080524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1374/2760] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:19 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:19.085027 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ac483-3ffd-4133-9dbf-17b0c6bafaa9 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:19.097916 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ac483-3ffd-4133-9dbf-17b0c6bafaa9 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:19.105421 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52183a3-973b-4bf0-bc65-61037a8e8297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:19.106516 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52183a3-973b-4bf0-bc65-61037a8e8297 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:19.107042 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52183a3-973b-4bf0-bc65-61037a8e8297 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:19.107585 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52183a3-973b-4bf0-bc65-61037a8e8297 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:19.109550 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52183a3-973b-4bf0-bc65-61037a8e8297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:19.112647 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52183a3-973b-4bf0-bc65-61037a8e8297 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:19.131742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1387/2761] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:19 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:19.135839 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7db18-733b-4c9d-bbc4-ee36c6ed28a0 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:19.145725 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7db18-733b-4c9d-bbc4-ee36c6ed28a0 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:19.150129 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:19.151031 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:19.151321 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:19.151595 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] PATH_INFO: `/v3/projects/f9b22951672c41ebab827e4bd99ceb3f/users/262766a974bf4c06b22a53a6b2af1d4d/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:19.172543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b22951672c41ebab827e4bd99ceb3f, user_id=262766a974bf4c06b22a53a6b2af1d4d, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:19.175174 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:19.188915 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1375/2762] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:19 2021] PUT /identity/v3/projects/f9b22951672c41ebab827e4bd99ceb3f/users/262766a974bf4c06b22a53a6b2af1d4d/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:19.200623 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead140-a66f-449d-bc32-e12beaf7bc21 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:19.201021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead140-a66f-449d-bc32-e12beaf7bc21 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:19.201367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead140-a66f-449d-bc32-e12beaf7bc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:19.239195 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-3aead140-a66f-449d-bc32-e12beaf7bc21 None None] MFA Rules not processed for user `262766a974bf4c06b22a53a6b2af1d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:19.240370 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-3aead140-a66f-449d-bc32-e12beaf7bc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:19.318817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1388/2763] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:19 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:19.329342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:19.331195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:19.401765 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dd1d2-e251-4db1-a360-f41242957655 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:19.405876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479df05-8354-41f2-92d3-04aec808d762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:19.406485 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479df05-8354-41f2-92d3-04aec808d762 service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:19.406770 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479df05-8354-41f2-92d3-04aec808d762 service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:19.407053 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479df05-8354-41f2-92d3-04aec808d762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:19.416115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479df05-8354-41f2-92d3-04aec808d762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:19.417519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479df05-8354-41f2-92d3-04aec808d762 service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:19.426618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1376/2764] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:19 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:28.473744 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aead140-a66f-449d-bc32-e12beaf7bc21 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:28.541682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aead140-a66f-449d-bc32-e12beaf7bc21 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:28.546024 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:28.546865 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:28.547157 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:28.547442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] PATH_INFO: `/v3/users/262766a974bf4c06b22a53a6b2af1d4d` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:28.548554 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=262766a974bf4c06b22a53a6b2af1d4d)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:28.550492 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:28.597166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262766a974bf4c06b22a53a6b2af1d4d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:28.604276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262766a974bf4c06b22a53a6b2af1d4d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:28.604723 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262766a974bf4c06b22a53a6b2af1d4d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:28.605327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262766a974bf4c06b22a53a6b2af1d4d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:28.617105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262766a974bf4c06b22a53a6b2af1d4d'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:28.630137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1389/2765] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:28 2021] DELETE /identity/v3/users/262766a974bf4c06b22a53a6b2af1d4d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:28.634780 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48516-3998-470c-a4e7-e4fd147342b9 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:28.635249 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48516-3998-470c-a4e7-e4fd147342b9 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:28.635372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48516-3998-470c-a4e7-e4fd147342b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:28.657507 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-11d48516-3998-470c-a4e7-e4fd147342b9 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:28.658667 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-11d48516-3998-470c-a4e7-e4fd147342b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:28.721176 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1377/2766] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:28.731500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:28.732817 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:28.798480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9cd37-66e8-429c-ab2b-2761192046cd admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:28.802275 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae32ff-8e7f-4e16-82b5-03a3bc443735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:28.802880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae32ff-8e7f-4e16-82b5-03a3bc443735 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:28.803166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae32ff-8e7f-4e16-82b5-03a3bc443735 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:28.803441 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae32ff-8e7f-4e16-82b5-03a3bc443735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:28.812800 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae32ff-8e7f-4e16-82b5-03a3bc443735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:28.814206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae32ff-8e7f-4e16-82b5-03a3bc443735 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:28.823167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1390/2767] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:29.193489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d48516-3998-470c-a4e7-e4fd147342b9 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:29.194945 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-11d48516-3998-470c-a4e7-e4fd147342b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:29.207074 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d48516-3998-470c-a4e7-e4fd147342b9 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:29.211373 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:29.212193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.212478 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.212759 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] PATH_INFO: `/v3/projects/f9b22951672c41ebab827e4bd99ceb3f` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.213857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b22951672c41ebab827e4bd99ceb3f)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:29.215755 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:29.264320 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b22951672c41ebab827e4bd99ceb3f', 'request_id': 'req-1fae006a-5587-46e8-80d3-645638aaa71c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:29.269108 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b22951672c41ebab827e4bd99ceb3f', 'request_id': 'req-1fae006a-5587-46e8-80d3-645638aaa71c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:29.275917 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b22951672c41ebab827e4bd99ceb3f', 'request_id': 'req-1fae006a-5587-46e8-80d3-645638aaa71c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:29.291260 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] The token cache is being invalidate because project f9b22951672c41ebab827e4bd99ceb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:29.291535 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:29.292150 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1fae006a-5587-46e8-80d3-645638aaa71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:29.293803 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1378/2768] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:29 2021] DELETE /identity/v3/projects/f9b22951672c41ebab827e4bd99ceb3f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:29.299650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd257-6e4d-415e-a2f7-004e7b9f297d None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.299942 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd257-6e4d-415e-a2f7-004e7b9f297d None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.300223 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd257-6e4d-415e-a2f7-004e7b9f297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.422323 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b20dd257-6e4d-415e-a2f7-004e7b9f297d None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:29.423489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b20dd257-6e4d-415e-a2f7-004e7b9f297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:29.487604 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1391/2769] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:29.495365 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6bddf-e552-440a-92ed-596af25296b5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.495655 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6bddf-e552-440a-92ed-596af25296b5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.495931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6bddf-e552-440a-92ed-596af25296b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.517470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-8ea6bddf-e552-440a-92ed-596af25296b5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:29.518566 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-8ea6bddf-e552-440a-92ed-596af25296b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:29.525550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1379/2770] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:29.529581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dd257-6e4d-415e-a2f7-004e7b9f297d None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:29.539284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dd257-6e4d-415e-a2f7-004e7b9f297d None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:29.543608 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:29.544193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.544480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.544779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.545442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:08:29.546274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:29.547909 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:29.560267 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1392/2771] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:08:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:08:29.564599 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6bddf-e552-440a-92ed-596af25296b5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:29.573305 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6bddf-e552-440a-92ed-596af25296b5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:29.577693 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e80a68-e674-44dd-97dd-1ef44b5dd051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:29.578268 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80a68-e674-44dd-97dd-1ef44b5dd051 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.578591 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80a68-e674-44dd-97dd-1ef44b5dd051 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.578876 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80a68-e674-44dd-97dd-1ef44b5dd051 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.579514 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e80a68-e674-44dd-97dd-1ef44b5dd051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:29.581379 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e80a68-e674-44dd-97dd-1ef44b5dd051 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:29.607364 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1380/2772] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:29 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:29.612268 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:29.621874 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d283-b772-4337-bf24-8df726f7f2b4 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:29.684781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869293-e816-4624-9ec6-8cca3d7dbdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:29.685384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869293-e816-4624-9ec6-8cca3d7dbdbe admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.685679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869293-e816-4624-9ec6-8cca3d7dbdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.685964 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869293-e816-4624-9ec6-8cca3d7dbdbe admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.686628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14869293-e816-4624-9ec6-8cca3d7dbdbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:29.688529 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14869293-e816-4624-9ec6-8cca3d7dbdbe admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:29.707320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1393/2773] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:29 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:29.711462 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e80a68-e674-44dd-97dd-1ef44b5dd051 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:29.727532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e80a68-e674-44dd-97dd-1ef44b5dd051 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:29.732664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d178c5-ab82-47d3-adbc-5dbb71bd213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:29.734130 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d178c5-ab82-47d3-adbc-5dbb71bd213a admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.734443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d178c5-ab82-47d3-adbc-5dbb71bd213a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.734724 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d178c5-ab82-47d3-adbc-5dbb71bd213a admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.735424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d178c5-ab82-47d3-adbc-5dbb71bd213a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:29.738726 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d178c5-ab82-47d3-adbc-5dbb71bd213a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:29.751452 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1381/2774] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:29 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:29.755627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869293-e816-4624-9ec6-8cca3d7dbdbe admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:29.765849 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869293-e816-4624-9ec6-8cca3d7dbdbe admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:29.770194 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c74b38-7981-4ac6-8ea1-05412a833fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:29.770742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b38-7981-4ac6-8ea1-05412a833fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.771029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b38-7981-4ac6-8ea1-05412a833fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.771313 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b38-7981-4ac6-8ea1-05412a833fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.771994 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c74b38-7981-4ac6-8ea1-05412a833fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:29.773570 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c74b38-7981-4ac6-8ea1-05412a833fa9 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:29.784209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1394/2775] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:29.788329 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d178c5-ab82-47d3-adbc-5dbb71bd213a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:29.798907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d178c5-ab82-47d3-adbc-5dbb71bd213a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:29.803350 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061142b-b31a-40f3-aaf7-29c8b8c64f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:29.804141 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061142b-b31a-40f3-aaf7-29c8b8c64f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.804469 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061142b-b31a-40f3-aaf7-29c8b8c64f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.804753 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061142b-b31a-40f3-aaf7-29c8b8c64f7d admin admin] PATH_INFO: `/v3/projects/5b2d14a3869d4f4785227c3faed70467/users/891cad17817d47eba4561d86580bce95/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.824908 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061142b-b31a-40f3-aaf7-29c8b8c64f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2d14a3869d4f4785227c3faed70467, user_id=891cad17817d47eba4561d86580bce95, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:29.828051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061142b-b31a-40f3-aaf7-29c8b8c64f7d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:29.840976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1382/2776] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:29 2021] PUT /identity/v3/projects/5b2d14a3869d4f4785227c3faed70467/users/891cad17817d47eba4561d86580bce95/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:29.853851 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1410-074c-401e-b939-222a89312deb None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:29.854233 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1410-074c-401e-b939-222a89312deb None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:29.854686 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1410-074c-401e-b939-222a89312deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:29.890857 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-e16d1410-074c-401e-b939-222a89312deb None None] MFA Rules not processed for user `891cad17817d47eba4561d86580bce95`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:29.891988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e16d1410-074c-401e-b939-222a89312deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:29.961349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1395/2777] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:29 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:29.965805 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061142b-b31a-40f3-aaf7-29c8b8c64f7d admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.034543 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061142b-b31a-40f3-aaf7-29c8b8c64f7d admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.039069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d940-5f3d-42dd-b557-c24fb6eeb579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.039689 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d940-5f3d-42dd-b557-c24fb6eeb579 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.040034 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d940-5f3d-42dd-b557-c24fb6eeb579 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.040360 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d940-5f3d-42dd-b557-c24fb6eeb579 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.041098 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d940-5f3d-42dd-b557-c24fb6eeb579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.043294 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d940-5f3d-42dd-b557-c24fb6eeb579 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.070513 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1383/2778] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:29 2021] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:30.074512 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d1410-074c-401e-b939-222a89312deb None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.085315 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d1410-074c-401e-b939-222a89312deb None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.147385 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6184aa-3c3f-41f1-8820-6be06b81f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.147987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6184aa-3c3f-41f1-8820-6be06b81f683 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.148279 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6184aa-3c3f-41f1-8820-6be06b81f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.148558 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6184aa-3c3f-41f1-8820-6be06b81f683 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.149186 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6184aa-3c3f-41f1-8820-6be06b81f683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.151124 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6184aa-3c3f-41f1-8820-6be06b81f683 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.169479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1396/2779] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:30 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:30.173722 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d940-5f3d-42dd-b557-c24fb6eeb579 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.184445 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d940-5f3d-42dd-b557-c24fb6eeb579 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.189911 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3cf2e-bb0e-4365-b219-124c73be7cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.190556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3cf2e-bb0e-4365-b219-124c73be7cbd admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.190840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3cf2e-bb0e-4365-b219-124c73be7cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.191116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3cf2e-bb0e-4365-b219-124c73be7cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.191801 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3cf2e-bb0e-4365-b219-124c73be7cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.193366 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3cf2e-bb0e-4365-b219-124c73be7cbd admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.204613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1384/2780] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:30.208767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6184aa-3c3f-41f1-8820-6be06b81f683 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.218479 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6184aa-3c3f-41f1-8820-6be06b81f683 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.222840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bb86e-77e7-46ba-abf3-a7bece3ba508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.223426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb86e-77e7-46ba-abf3-a7bece3ba508 admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.223717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb86e-77e7-46ba-abf3-a7bece3ba508 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.224000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb86e-77e7-46ba-abf3-a7bece3ba508 admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.224684 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bb86e-77e7-46ba-abf3-a7bece3ba508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.226258 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bb86e-77e7-46ba-abf3-a7bece3ba508 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.236542 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1397/2781] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:30 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:30.240659 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3cf2e-bb0e-4365-b219-124c73be7cbd admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.250635 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3cf2e-bb0e-4365-b219-124c73be7cbd admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.254958 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a153011-a205-4c4c-a5ac-c4fc999b7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.255761 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a153011-a205-4c4c-a5ac-c4fc999b7dae admin admin] REQUEST_METHOD: `PUT` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.256051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a153011-a205-4c4c-a5ac-c4fc999b7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.256333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a153011-a205-4c4c-a5ac-c4fc999b7dae admin admin] PATH_INFO: `/v3/projects/9af1055eed4c4923b8f90f0a7e791904/users/77c9483ee0254d06bea2886c1f15bd0c/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.276321 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a153011-a205-4c4c-a5ac-c4fc999b7dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af1055eed4c4923b8f90f0a7e791904, user_id=77c9483ee0254d06bea2886c1f15bd0c, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.278975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a153011-a205-4c4c-a5ac-c4fc999b7dae admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.291490 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1385/2782] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:30 2021] PUT /identity/v3/projects/9af1055eed4c4923b8f90f0a7e791904/users/77c9483ee0254d06bea2886c1f15bd0c/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:30.302651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f3669-eaae-48e3-b3fc-520defd16140 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.302948 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f3669-eaae-48e3-b3fc-520defd16140 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.303235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f3669-eaae-48e3-b3fc-520defd16140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.340070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-6e6f3669-eaae-48e3-b3fc-520defd16140 None None] MFA Rules not processed for user `77c9483ee0254d06bea2886c1f15bd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:30.341254 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-6e6f3669-eaae-48e3-b3fc-520defd16140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:30.413079 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1398/2783] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:30 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:30.417489 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a153011-a205-4c4c-a5ac-c4fc999b7dae admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.484295 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a153011-a205-4c4c-a5ac-c4fc999b7dae admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.488927 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8e41e-2100-483e-8faf-b4c93b4f99a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.489508 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8e41e-2100-483e-8faf-b4c93b4f99a7 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.489798 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8e41e-2100-483e-8faf-b4c93b4f99a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.490082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8e41e-2100-483e-8faf-b4c93b4f99a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.490769 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8e41e-2100-483e-8faf-b4c93b4f99a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.492647 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8e41e-2100-483e-8faf-b4c93b4f99a7 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.518040 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1386/2784] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:30 2021] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:30.522083 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f3669-eaae-48e3-b3fc-520defd16140 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.532536 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f3669-eaae-48e3-b3fc-520defd16140 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.593725 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da2f4-80ad-4952-a9d8-4ee6466263f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.594257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da2f4-80ad-4952-a9d8-4ee6466263f7 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.594595 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da2f4-80ad-4952-a9d8-4ee6466263f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.594869 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da2f4-80ad-4952-a9d8-4ee6466263f7 admin admin] PATH_INFO: `/v3/users` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.595537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da2f4-80ad-4952-a9d8-4ee6466263f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.597467 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da2f4-80ad-4952-a9d8-4ee6466263f7 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.618135 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1399/2785] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:30 2021] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:30.622188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8e41e-2100-483e-8faf-b4c93b4f99a7 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.632618 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8e41e-2100-483e-8faf-b4c93b4f99a7 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.637033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3187f-8345-46d3-a99e-4fecdaf02edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.637619 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3187f-8345-46d3-a99e-4fecdaf02edc admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.637912 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3187f-8345-46d3-a99e-4fecdaf02edc admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.638193 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3187f-8345-46d3-a99e-4fecdaf02edc admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.638928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3187f-8345-46d3-a99e-4fecdaf02edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.640541 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3187f-8345-46d3-a99e-4fecdaf02edc admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.651023 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1387/2786] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:30.654977 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da2f4-80ad-4952-a9d8-4ee6466263f7 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.664589 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da2f4-80ad-4952-a9d8-4ee6466263f7 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.669023 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd69b1-a5fe-44b1-a130-5bb1cd60f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.669835 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd69b1-a5fe-44b1-a130-5bb1cd60f1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.670132 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd69b1-a5fe-44b1-a130-5bb1cd60f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.670915 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd69b1-a5fe-44b1-a130-5bb1cd60f1c3 admin admin] PATH_INFO: `/v3/projects/e9961683e25c4b1b8e76e8b046f3e6df/users/f81b8b4a4adc45a0b4570fe41e52a39b/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.690872 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd69b1-a5fe-44b1-a130-5bb1cd60f1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9961683e25c4b1b8e76e8b046f3e6df, user_id=f81b8b4a4adc45a0b4570fe41e52a39b, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.693509 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd69b1-a5fe-44b1-a130-5bb1cd60f1c3 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.706062 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1400/2787] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:30 2021] PUT /identity/v3/projects/e9961683e25c4b1b8e76e8b046f3e6df/users/f81b8b4a4adc45a0b4570fe41e52a39b/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:30.710069 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3187f-8345-46d3-a99e-4fecdaf02edc admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.719495 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3187f-8345-46d3-a99e-4fecdaf02edc admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.781156 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee475c17-35d4-4ae4-b1cf-e97f964a0f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.781781 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475c17-35d4-4ae4-b1cf-e97f964a0f62 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.782091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475c17-35d4-4ae4-b1cf-e97f964a0f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.782355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475c17-35d4-4ae4-b1cf-e97f964a0f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.783082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee475c17-35d4-4ae4-b1cf-e97f964a0f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.784658 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee475c17-35d4-4ae4-b1cf-e97f964a0f62 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.794825 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1388/2788] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:30 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:30.799436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd69b1-a5fe-44b1-a130-5bb1cd60f1c3 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.809507 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd69b1-a5fe-44b1-a130-5bb1cd60f1c3 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:30.814502 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:30.815327 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.815620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.815906 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] PATH_INFO: `/v3/projects/e9961683e25c4b1b8e76e8b046f3e6df/users/f81b8b4a4adc45a0b4570fe41e52a39b/roles/98f77a1006404111a8be8686551c8675` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.817699 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9961683e25c4b1b8e76e8b046f3e6df, user_id=f81b8b4a4adc45a0b4570fe41e52a39b, role_id=98f77a1006404111a8be8686551c8675)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:30.820349 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:30.830234 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1401/2789] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:30 2021] PUT /identity/v3/projects/e9961683e25c4b1b8e76e8b046f3e6df/users/f81b8b4a4adc45a0b4570fe41e52a39b/roles/98f77a1006404111a8be8686551c8675 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:08:30.840355 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea11f4-b94e-4235-a757-cd0d09d52b4e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:30.840713 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea11f4-b94e-4235-a757-cd0d09d52b4e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:30.840998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea11f4-b94e-4235-a757-cd0d09d52b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:30.880442 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-c4ea11f4-b94e-4235-a757-cd0d09d52b4e None None] MFA Rules not processed for user `f81b8b4a4adc45a0b4570fe41e52a39b`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:30.881586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c4ea11f4-b94e-4235-a757-cd0d09d52b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:30.956968 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1389/2790] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:30 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:30.967050 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:30.969247 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:31.034190 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943864b-75a0-4d30-9378-dcc7f1fec0c2 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:31.037774 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d2e5b-e41f-4885-9f8a-847fd6913965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:31.038357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2e5b-e41f-4885-9f8a-847fd6913965 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:31.038679 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2e5b-e41f-4885-9f8a-847fd6913965 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:31.038966 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2e5b-e41f-4885-9f8a-847fd6913965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:31.106340 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d2e5b-e41f-4885-9f8a-847fd6913965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:31.107722 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d2e5b-e41f-4885-9f8a-847fd6913965 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:31.125501 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1402/2791] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:30 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:32.837165 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea11f4-b94e-4235-a757-cd0d09d52b4e None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:32.838547 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-c4ea11f4-b94e-4235-a757-cd0d09d52b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:32.851698 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea11f4-b94e-4235-a757-cd0d09d52b4e None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:32.855645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347908-d2f6-4f7a-91fc-75e0439318ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:32.856126 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347908-d2f6-4f7a-91fc-75e0439318ab service cinder] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:32.856407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347908-d2f6-4f7a-91fc-75e0439318ab service cinder] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:32.856683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347908-d2f6-4f7a-91fc-75e0439318ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:32.920673 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347908-d2f6-4f7a-91fc-75e0439318ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:32.922089 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347908-d2f6-4f7a-91fc-75e0439318ab service cinder] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:32.930524 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1390/2792] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:32 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:33.677561 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d2e5b-e41f-4885-9f8a-847fd6913965 service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:33.686844 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d2e5b-e41f-4885-9f8a-847fd6913965 service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:33.690429 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182b06c-fddb-4c59-a2a0-ca33aca841c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:33.690995 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b06c-fddb-4c59-a2a0-ca33aca841c1 service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:33.691284 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b06c-fddb-4c59-a2a0-ca33aca841c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:33.691566 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b06c-fddb-4c59-a2a0-ca33aca841c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:33.700335 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182b06c-fddb-4c59-a2a0-ca33aca841c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:33.701748 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182b06c-fddb-4c59-a2a0-ca33aca841c1 service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:33.710773 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1403/2793] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:33 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:38.156274 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347908-d2f6-4f7a-91fc-75e0439318ab service cinder] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:38.222998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347908-d2f6-4f7a-91fc-75e0439318ab service cinder] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:38.227426 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:38.228256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:38.228544 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:38.228826 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] PATH_INFO: `/v3/users/891cad17817d47eba4561d86580bce95` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:38.229924 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891cad17817d47eba4561d86580bce95)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:38.231891 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:38.278195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891cad17817d47eba4561d86580bce95'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.284642 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891cad17817d47eba4561d86580bce95'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.285267 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891cad17817d47eba4561d86580bce95'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.285874 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891cad17817d47eba4561d86580bce95'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.293486 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891cad17817d47eba4561d86580bce95'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.310259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1391/2794] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:38 2021] DELETE /identity/v3/users/891cad17817d47eba4561d86580bce95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:38.315537 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840233e-bb96-4409-9600-a733a3c1cd09 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:38.316075 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840233e-bb96-4409-9600-a733a3c1cd09 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:38.316197 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840233e-bb96-4409-9600-a733a3c1cd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:38.338612 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-0840233e-bb96-4409-9600-a733a3c1cd09 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:38.339757 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0840233e-bb96-4409-9600-a733a3c1cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:38.403891 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1404/2795] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:38.414488 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:38.416048 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:38.478653 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e26ba-e277-46bf-a44a-6668ef23b257 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:38.482097 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63d5f4-e63d-4868-8c91-9ce1583dcf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:38.482699 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d5f4-e63d-4868-8c91-9ce1583dcf76 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:38.483574 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d5f4-e63d-4868-8c91-9ce1583dcf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:38.483857 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d5f4-e63d-4868-8c91-9ce1583dcf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:38.492959 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63d5f4-e63d-4868-8c91-9ce1583dcf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:38.494372 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63d5f4-e63d-4868-8c91-9ce1583dcf76 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:38.503298 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1392/2796] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:38.858579 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840233e-bb96-4409-9600-a733a3c1cd09 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:38.860206 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-0840233e-bb96-4409-9600-a733a3c1cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:38.872743 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840233e-bb96-4409-9600-a733a3c1cd09 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:38.882108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:38.882921 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:38.883210 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:38.883489 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] PATH_INFO: `/v3/projects/5b2d14a3869d4f4785227c3faed70467` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:38.884582 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2d14a3869d4f4785227c3faed70467)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:38.886514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:38.938938 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2d14a3869d4f4785227c3faed70467', 'request_id': 'req-ea0478bb-1425-4802-83ae-19da7d062a81'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.943985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2d14a3869d4f4785227c3faed70467', 'request_id': 'req-ea0478bb-1425-4802-83ae-19da7d062a81'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.950870 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2d14a3869d4f4785227c3faed70467', 'request_id': 'req-ea0478bb-1425-4802-83ae-19da7d062a81'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.967239 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] The token cache is being invalidate because project 5b2d14a3869d4f4785227c3faed70467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:38.968067 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.968704 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:38.970166 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1405/2797] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:38 2021] DELETE /identity/v3/projects/5b2d14a3869d4f4785227c3faed70467 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:08:38.974143 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63d5f4-e63d-4868-8c91-9ce1583dcf76 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:38.984407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63d5f4-e63d-4868-8c91-9ce1583dcf76 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:39.045931 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:39.046766 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:39.047055 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:39.047335 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] PATH_INFO: `/v3/users/77c9483ee0254d06bea2886c1f15bd0c` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:39.048443 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c9483ee0254d06bea2886c1f15bd0c)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:39.050342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:39.097331 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c9483ee0254d06bea2886c1f15bd0c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.103940 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c9483ee0254d06bea2886c1f15bd0c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.104554 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c9483ee0254d06bea2886c1f15bd0c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.105154 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c9483ee0254d06bea2886c1f15bd0c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.112895 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c9483ee0254d06bea2886c1f15bd0c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.129604 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1393/2798] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:38 2021] DELETE /identity/v3/users/77c9483ee0254d06bea2886c1f15bd0c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:39.579319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:39.581586 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:39.597446 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0478bb-1425-4802-83ae-19da7d062a81 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:39.659203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:39.660084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:39.660408 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:39.660697 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] PATH_INFO: `/v3/projects/9af1055eed4c4923b8f90f0a7e791904` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:39.661815 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af1055eed4c4923b8f90f0a7e791904)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:39.663795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:39.712484 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af1055eed4c4923b8f90f0a7e791904', 'request_id': 'req-22edf46a-3478-4679-909f-ede45d15912e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.717405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af1055eed4c4923b8f90f0a7e791904', 'request_id': 'req-22edf46a-3478-4679-909f-ede45d15912e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.724274 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af1055eed4c4923b8f90f0a7e791904', 'request_id': 'req-22edf46a-3478-4679-909f-ede45d15912e'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.740730 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] The token cache is being invalidate because project 9af1055eed4c4923b8f90f0a7e791904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:39.741015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.741626 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.743084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1406/2799] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:39 2021] DELETE /identity/v3/projects/9af1055eed4c4923b8f90f0a7e791904 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:39.747016 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:39.748414 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:39.760975 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32a8ca-1c43-4aad-b163-a98dd3047619 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:39.825470 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:39.826276 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:39.826597 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:39.826898 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] PATH_INFO: `/v3/users/f81b8b4a4adc45a0b4570fe41e52a39b` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:39.827998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81b8b4a4adc45a0b4570fe41e52a39b)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:39.829892 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:39.880548 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81b8b4a4adc45a0b4570fe41e52a39b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.887417 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81b8b4a4adc45a0b4570fe41e52a39b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.888041 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81b8b4a4adc45a0b4570fe41e52a39b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.888621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81b8b4a4adc45a0b4570fe41e52a39b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.896325 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-8a4a4bba-5eb2-43a0-aba4-75020d41cd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81b8b4a4adc45a0b4570fe41e52a39b'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:39.913564 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1394/2800] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:08:39 2021] DELETE /identity/v3/users/f81b8b4a4adc45a0b4570fe41e52a39b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:08:40.382746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:40.384108 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:40.396357 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edf46a-3478-4679-909f-ede45d15912e admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:40.462235 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:40.464160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.464160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.464160 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] PATH_INFO: `/v3/projects/e9961683e25c4b1b8e76e8b046f3e6df` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.465049 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9961683e25c4b1b8e76e8b046f3e6df)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:40.467959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:40.516555 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9961683e25c4b1b8e76e8b046f3e6df', 'request_id': 'req-ec7f56e1-1862-4055-b27e-fb948892f3e8'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:40.521402 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9961683e25c4b1b8e76e8b046f3e6df', 'request_id': 'req-ec7f56e1-1862-4055-b27e-fb948892f3e8'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:40.528294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9961683e25c4b1b8e76e8b046f3e6df', 'request_id': 'req-ec7f56e1-1862-4055-b27e-fb948892f3e8'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:40.547639 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] The token cache is being invalidate because project e9961683e25c4b1b8e76e8b046f3e6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:08:40.547934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:40.548594 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-ec7f56e1-1862-4055-b27e-fb948892f3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:08:40.550078 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1407/2801] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:08:40 2021] DELETE /identity/v3/projects/e9961683e25c4b1b8e76e8b046f3e6df => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:08:40.555645 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa120e8e-0076-4c7c-ad33-387cf2a1b2d5 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.555946 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa120e8e-0076-4c7c-ad33-387cf2a1b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.556259 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa120e8e-0076-4c7c-ad33-387cf2a1b2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.578778 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-aa120e8e-0076-4c7c-ad33-387cf2a1b2d5 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:40.579956 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-aa120e8e-0076-4c7c-ad33-387cf2a1b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:40.645593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1395/2802] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:40.653584 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6e380-968c-4420-9495-c2282a0cc4d6 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.654061 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6e380-968c-4420-9495-c2282a0cc4d6 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.654161 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6e380-968c-4420-9495-c2282a0cc4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.675801 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-d7b6e380-968c-4420-9495-c2282a0cc4d6 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:40.676947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-d7b6e380-968c-4420-9495-c2282a0cc4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:40.683985 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1408/2803] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:40.688786 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa120e8e-0076-4c7c-ad33-387cf2a1b2d5 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:40.699483 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa120e8e-0076-4c7c-ad33-387cf2a1b2d5 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:40.704466 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:40.705051 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.705342 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.705628 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.706315 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:08:40.706649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:40.708214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:40.720796 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1396/2804] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:08:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 15:08:40.724628 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6e380-968c-4420-9495-c2282a0cc4d6 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:40.733224 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6e380-968c-4420-9495-c2282a0cc4d6 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:40.738175 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31b99-72da-4f7a-868d-e0c524ef7302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:40.738795 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31b99-72da-4f7a-868d-e0c524ef7302 admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.739084 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31b99-72da-4f7a-868d-e0c524ef7302 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.739363 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31b99-72da-4f7a-868d-e0c524ef7302 admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.740011 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e31b99-72da-4f7a-868d-e0c524ef7302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:40.741883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e31b99-72da-4f7a-868d-e0c524ef7302 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:40.768539 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1409/2805] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:08:40 2021] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:08:40.772556 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:40.782091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c811d18-e7b9-4644-9774-077a246eaf30 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:40.844195 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aa3fc-4d09-4525-9cdd-8165a34a69c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:40.844799 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aa3fc-4d09-4525-9cdd-8165a34a69c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.845091 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aa3fc-4d09-4525-9cdd-8165a34a69c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.845377 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aa3fc-4d09-4525-9cdd-8165a34a69c6 admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.846093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578aa3fc-4d09-4525-9cdd-8165a34a69c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:40.848519 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578aa3fc-4d09-4525-9cdd-8165a34a69c6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:40.868211 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1397/2806] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:08:40 2021] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:08:40.872572 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31b99-72da-4f7a-868d-e0c524ef7302 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:40.884245 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31b99-72da-4f7a-868d-e0c524ef7302 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:40.888741 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886ef11-45be-4fcc-80b9-21bf1a63f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:40.889886 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886ef11-45be-4fcc-80b9-21bf1a63f2af admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.890169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886ef11-45be-4fcc-80b9-21bf1a63f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.890581 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886ef11-45be-4fcc-80b9-21bf1a63f2af admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.891181 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886ef11-45be-4fcc-80b9-21bf1a63f2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:40.892751 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886ef11-45be-4fcc-80b9-21bf1a63f2af admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:40.902840 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1410/2807] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:08:40.906842 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aa3fc-4d09-4525-9cdd-8165a34a69c6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:40.916147 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aa3fc-4d09-4525-9cdd-8165a34a69c6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:40.920516 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0676a3-08b6-48b2-b081-82af5a212c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:40.921114 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0676a3-08b6-48b2-b081-82af5a212c34 admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.921399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0676a3-08b6-48b2-b081-82af5a212c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.921677 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0676a3-08b6-48b2-b081-82af5a212c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.922363 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0676a3-08b6-48b2-b081-82af5a212c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:40.923957 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0676a3-08b6-48b2-b081-82af5a212c34 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:40.933816 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1398/2808] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:08:40 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:08:40.938599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886ef11-45be-4fcc-80b9-21bf1a63f2af admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:40.947987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886ef11-45be-4fcc-80b9-21bf1a63f2af admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:40.953053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:40.953877 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.954169 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.954485 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] PATH_INFO: `/v3/projects/9891c1af8b9f4c648beba9cb5abf4126/users/d065a756642042b29dbd5b60129de6ea/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:40.973525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9891c1af8b9f4c648beba9cb5abf4126, user_id=d065a756642042b29dbd5b60129de6ea, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:40.976120 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:40.989717 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1411/2809] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:08:40 2021] PUT /identity/v3/projects/9891c1af8b9f4c648beba9cb5abf4126/users/d065a756642042b29dbd5b60129de6ea/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:08:40.995138 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7fcf-d109-4b96-b295-a559fe6517f2 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:40.995401 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7fcf-d109-4b96-b295-a559fe6517f2 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:40.995795 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7fcf-d109-4b96-b295-a559fe6517f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:41.017928 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-b67c7fcf-d109-4b96-b295-a559fe6517f2 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:41.019115 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b67c7fcf-d109-4b96-b295-a559fe6517f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:41.082921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1399/2810] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:41.094707 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:41.096312 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:41.158770 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8015e9-4e24-4d83-b421-55bfdb858d72 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:41.162510 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:41.163092 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:41.163383 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:41.163669 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:41.174159 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:41.177607 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:41.187636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1412/2811] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:41.952840 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093660b-d33a-418d-bd00-ebe54ce644e3 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:41.953400 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093660b-d33a-418d-bd00-ebe54ce644e3 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:41.953400 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093660b-d33a-418d-bd00-ebe54ce644e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:41.990846 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-d093660b-d33a-418d-bd00-ebe54ce644e3 None None] MFA Rules not processed for user `d065a756642042b29dbd5b60129de6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:41.992015 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-d093660b-d33a-418d-bd00-ebe54ce644e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:42.065136 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1400/2812] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:41 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:42.074776 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:42.076136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:42.142797 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6f6b-452f-4249-acb6-4192a538f59c service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:42.146320 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:42.146947 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:42.147237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:42.147518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:42.156171 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:42.157636 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:42.166545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1413/2813] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:42 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:08:43.677784 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df397ce7-8db5-4a4c-9ed3-978e97ac492e None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:43.678283 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df397ce7-8db5-4a4c-9ed3-978e97ac492e None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:43.678424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df397ce7-8db5-4a4c-9ed3-978e97ac492e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:43.700043 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-df397ce7-8db5-4a4c-9ed3-978e97ac492e None None] MFA Rules not processed for user `d065a756642042b29dbd5b60129de6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:08:43.701184 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-df397ce7-8db5-4a4c-9ed3-978e97ac492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:43.708119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1401/2814] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:08:43 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:08:53.252074 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:08:53.253713 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:53.401742 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e174-ff46-487b-b8b0-33f4d56ebc0a service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:08:53.409694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:08:53.410449 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:08:53.410746 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:08:53.411028 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:08:53.412768 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:08:53.425600 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:08:53.427203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:08:53.437065 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1414/2815] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:08:53 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:09:00.548033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff272b-e045-4342-a57d-ee709d4086e0 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:00.548598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff272b-e045-4342-a57d-ee709d4086e0 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:00.548598 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff272b-e045-4342-a57d-ee709d4086e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:00.570593 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-eeff272b-e045-4342-a57d-ee709d4086e0 None None] MFA Rules not processed for user `d065a756642042b29dbd5b60129de6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:09:00.571744 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-eeff272b-e045-4342-a57d-ee709d4086e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:00.578004 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1402/2816] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:09:00 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:09:00.895969 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:00.916309 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8023ece-5b1f-43da-bd02-e452894ed93c service nova] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:00.920008 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:00.920629 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:00.920918 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:00.921200 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:00.923469 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:00.952252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:00.953692 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:00.962173 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1415/2817] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:09:00 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:09:24.588256 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743615d-aa07-495e-92c4-07af23be0cd8 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:24.588774 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743615d-aa07-495e-92c4-07af23be0cd8 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:24.588879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743615d-aa07-495e-92c4-07af23be0cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:24.612921 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-6743615d-aa07-495e-92c4-07af23be0cd8 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:09:24.614800 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-6743615d-aa07-495e-92c4-07af23be0cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:24.677591 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1403/2818] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 25 15:09:24 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:09:24.724252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:24.725620 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:24.799447 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8fe92-9ac2-49eb-863f-e2aa45575ff6 service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:24.805894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63fa46-5a2a-40c4-bce7-734f4e1fd51f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:24.806514 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63fa46-5a2a-40c4-bce7-734f4e1fd51f service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:24.806894 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63fa46-5a2a-40c4-bce7-734f4e1fd51f service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:24.807088 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63fa46-5a2a-40c4-bce7-734f4e1fd51f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:24.816140 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63fa46-5a2a-40c4-bce7-734f4e1fd51f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:24.817718 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63fa46-5a2a-40c4-bce7-734f4e1fd51f service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:24.825637 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1416/2819] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:09:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:09:38.931739 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262840-5720-4724-ab8a-bf35536ae744 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:38.932238 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262840-5720-4724-ab8a-bf35536ae744 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:38.932375 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262840-5720-4724-ab8a-bf35536ae744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:38.968815 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-b7262840-5720-4724-ab8a-bf35536ae744 None None] MFA Rules not processed for user `5a908a2911b944ccad0f51b8242fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:09:38.969964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b7262840-5720-4724-ab8a-bf35536ae744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:38.976621 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1404/2820] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 25 15:09:38 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:09:38.989127 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63fa46-5a2a-40c4-bce7-734f4e1fd51f service swift] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:38.999442 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63fa46-5a2a-40c4-bce7-734f4e1fd51f service swift] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:39.004280 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41f7d9-233c-4c0b-bece-05bd1f14d708 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514d94b70d2d4b14b99a9b235942723e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:39.004843 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f7d9-233c-4c0b-bece-05bd1f14d708 service swift] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:39.005129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f7d9-233c-4c0b-bece-05bd1f14d708 service swift] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:39.005410 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f7d9-233c-4c0b-bece-05bd1f14d708 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:39.013396 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41f7d9-233c-4c0b-bece-05bd1f14d708 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:39.015789 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41f7d9-233c-4c0b-bece-05bd1f14d708 service swift] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:39.023563 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1417/2821] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 25 15:09:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 15:09:41.357421 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7262840-5720-4724-ab8a-bf35536ae744 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:41.391459 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7262840-5720-4724-ab8a-bf35536ae744 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:41.395865 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:41.396720 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:41.397002 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:41.397278 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] PATH_INFO: `/v3/users/d065a756642042b29dbd5b60129de6ea` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:41.398473 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d065a756642042b29dbd5b60129de6ea)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:41.400389 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:41.447471 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd065a756642042b29dbd5b60129de6ea'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.454751 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd065a756642042b29dbd5b60129de6ea'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.455391 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd065a756642042b29dbd5b60129de6ea'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.455979 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd065a756642042b29dbd5b60129de6ea'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.464083 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-b4875e35-1639-442a-8dda-c04483e5d82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd065a756642042b29dbd5b60129de6ea'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.480718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1405/2822] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:09:41 2021] DELETE /identity/v3/users/d065a756642042b29dbd5b60129de6ea => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:09:41.702116 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41f7d9-233c-4c0b-bece-05bd1f14d708 service swift] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:41.712257 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41f7d9-233c-4c0b-bece-05bd1f14d708 service swift] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:41.778294 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:41.783251 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:41.783545 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:41.784000 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] PATH_INFO: `/v3/projects/9891c1af8b9f4c648beba9cb5abf4126` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:41.785255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9891c1af8b9f4c648beba9cb5abf4126)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:41.787260 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:41.837829 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9891c1af8b9f4c648beba9cb5abf4126', 'request_id': 'req-b31f1f26-95db-4672-9400-e52f654aca55'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.843430 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9891c1af8b9f4c648beba9cb5abf4126', 'request_id': 'req-b31f1f26-95db-4672-9400-e52f654aca55'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.852209 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9891c1af8b9f4c648beba9cb5abf4126', 'request_id': 'req-b31f1f26-95db-4672-9400-e52f654aca55'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.887987 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] The token cache is being invalidate because project 9891c1af8b9f4c648beba9cb5abf4126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:09:41.888317 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.888897 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-b31f1f26-95db-4672-9400-e52f654aca55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:09:41.890433 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1418/2823] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:09:41 2021] DELETE /identity/v3/projects/9891c1af8b9f4c648beba9cb5abf4126 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:09:41.897664 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03545bc6-d0fa-4723-a7aa-09fa7b4efc1f None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:41.897964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03545bc6-d0fa-4723-a7aa-09fa7b4efc1f None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:41.898250 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03545bc6-d0fa-4723-a7aa-09fa7b4efc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:41.972037 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-03545bc6-d0fa-4723-a7aa-09fa7b4efc1f None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:09:41.973101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-03545bc6-d0fa-4723-a7aa-09fa7b4efc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:42.035953 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1406/2824] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:09:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:09:42.043816 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eff4f-1fc6-42c6-9ca1-ce61d904f313 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.044137 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eff4f-1fc6-42c6-9ca1-ce61d904f313 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.044426 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eff4f-1fc6-42c6-9ca1-ce61d904f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.067287 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-f11eff4f-1fc6-42c6-9ca1-ce61d904f313 None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:09:42.068599 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-f11eff4f-1fc6-42c6-9ca1-ce61d904f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:42.076055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1419/2825] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:09:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:09:42.080395 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03545bc6-d0fa-4723-a7aa-09fa7b4efc1f None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:42.089776 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03545bc6-d0fa-4723-a7aa-09fa7b4efc1f None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:42.094969 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:42.095550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.095836 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.096117 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] PATH_INFO: `/v3/domains` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.096807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 15:09:42.097213 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:42.098982 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:42.112503 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1407/2826] 10.222.0.57 () {58 vars in 1152 bytes} [Mon Oct 25 15:09:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 15:09:42.116883 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eff4f-1fc6-42c6-9ca1-ce61d904f313 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:42.125703 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eff4f-1fc6-42c6-9ca1-ce61d904f313 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:42.130203 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa1418-c5e1-4091-937e-dfa4a31831db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:42.130818 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1418-c5e1-4091-937e-dfa4a31831db admin admin] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.131105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1418-c5e1-4091-937e-dfa4a31831db admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.131384 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1418-c5e1-4091-937e-dfa4a31831db admin admin] PATH_INFO: `/v3/projects` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.132012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa1418-c5e1-4091-937e-dfa4a31831db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:42.133880 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa1418-c5e1-4091-937e-dfa4a31831db admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:42.163193 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1420/2827] 10.222.0.57 () {60 vars in 1152 bytes} [Mon Oct 25 15:09:42 2021] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 15:09:42.167947 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:42.178125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e40d63-9306-4689-9f9f-9f634f0c27cb admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:42.240546 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35ff4-124c-4d97-95b8-b8697cecde4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:42.241042 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35ff4-124c-4d97-95b8-b8697cecde4f admin admin] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.241330 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35ff4-124c-4d97-95b8-b8697cecde4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.241613 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35ff4-124c-4d97-95b8-b8697cecde4f admin admin] PATH_INFO: `/v3/users` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.242241 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa35ff4-124c-4d97-95b8-b8697cecde4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:42.244188 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa35ff4-124c-4d97-95b8-b8697cecde4f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:42.264416 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1408/2828] 10.222.0.57 () {60 vars in 1143 bytes} [Mon Oct 25 15:09:42 2021] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 15:09:42.268565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa1418-c5e1-4091-937e-dfa4a31831db admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:42.278334 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa1418-c5e1-4091-937e-dfa4a31831db admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:42.283259 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d75e66-05f9-444b-8865-4f00242c227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:42.283848 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d75e66-05f9-444b-8865-4f00242c227d admin admin] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.284133 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d75e66-05f9-444b-8865-4f00242c227d admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.284412 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d75e66-05f9-444b-8865-4f00242c227d admin admin] PATH_INFO: `/v3/roles` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.285100 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d75e66-05f9-444b-8865-4f00242c227d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:42.286700 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d75e66-05f9-444b-8865-4f00242c227d admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:42.297112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1421/2829] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 15:09:42.300986 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35ff4-124c-4d97-95b8-b8697cecde4f admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:42.310528 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35ff4-124c-4d97-95b8-b8697cecde4f admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:42.314950 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e373f-3d75-4fb8-9bf3-f465d867016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:42.315540 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e373f-3d75-4fb8-9bf3-f465d867016f admin admin] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.315832 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e373f-3d75-4fb8-9bf3-f465d867016f admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.316116 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e373f-3d75-4fb8-9bf3-f465d867016f admin admin] PATH_INFO: `/v3/roles` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.316807 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e373f-3d75-4fb8-9bf3-f465d867016f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:42.318429 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e373f-3d75-4fb8-9bf3-f465d867016f admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:42.328333 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1409/2830] 10.222.0.57 () {58 vars in 1121 bytes} [Mon Oct 25 15:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 15:09:42.332319 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d75e66-05f9-444b-8865-4f00242c227d admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:42.342528 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d75e66-05f9-444b-8865-4f00242c227d admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:42.346804 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:42.347602 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.347887 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.348163 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] PATH_INFO: `/v3/projects/625aa939803a4496848addf4d08fba77/users/20d06ebe071645d8bf13f9950bd65112/roles/0b0b301f8db844b1903d147750c7e79c` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.369959 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=625aa939803a4496848addf4d08fba77, user_id=20d06ebe071645d8bf13f9950bd65112, role_id=0b0b301f8db844b1903d147750c7e79c)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:42.374500 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:42.387480 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1422/2831] 10.222.0.57 () {60 vars in 1482 bytes} [Mon Oct 25 15:09:42 2021] PUT /identity/v3/projects/625aa939803a4496848addf4d08fba77/users/20d06ebe071645d8bf13f9950bd65112/roles/0b0b301f8db844b1903d147750c7e79c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 15:09:42.392579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1f73-9ae9-46f9-bad3-4f877871ebde None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.393066 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1f73-9ae9-46f9-bad3-4f877871ebde None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.393257 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1f73-9ae9-46f9-bad3-4f877871ebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.415476 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-735c1f73-9ae9-46f9-bad3-4f877871ebde None None] MFA Rules not processed for user `c3aab5572b2c402b81621b54bfffba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:09:42.416663 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-735c1f73-9ae9-46f9-bad3-4f877871ebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:42.481568 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1410/2832] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:09:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:09:42.492105 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:42.493644 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:42.558222 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecee1e-9182-487e-8f70-58a421e36c1b admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:42.561781 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:42.562360 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:42.562682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:42.562963 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:42.571856 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:42.573276 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:42.583015 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1423/2833] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:09:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:09:43.386583 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161c50-52a0-4dff-8561-2c7fbd4ba6ce None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:43.386879 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161c50-52a0-4dff-8561-2c7fbd4ba6ce None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:43.387162 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161c50-52a0-4dff-8561-2c7fbd4ba6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:43.424285 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-27161c50-52a0-4dff-8561-2c7fbd4ba6ce None None] MFA Rules not processed for user `20d06ebe071645d8bf13f9950bd65112`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:09:43.425571 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-27161c50-52a0-4dff-8561-2c7fbd4ba6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:43.497247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1411/2834] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:09:43 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:09:43.508465 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:43.509923 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:43.575682 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f320d7a-820f-4221-b8b5-cfa6b6144fca service neutron] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:43.579460 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ed619258a14a148654f372f3a6a6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:43.580036 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:43.580321 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:43.580593 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:43.589404 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:43.590871 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:43.599970 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1424/2835] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:09:43 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:09:45.116998 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f8996-bb51-4177-8081-7e43e788dd73 None None] REQUEST_METHOD: `POST` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:45.117532 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f8996-bb51-4177-8081-7e43e788dd73 None None] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:45.117649 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f8996-bb51-4177-8081-7e43e788dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:45.139788 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.auth.core [None req-976f8996-bb51-4177-8081-7e43e788dd73 None None] MFA Rules not processed for user `20d06ebe071645d8bf13f9950bd65112`. Rule list: `[]` (Enabled: `True`). {{(pid=66563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:09:45.140907 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-976f8996-bb51-4177-8081-7e43e788dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:45.147121 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1412/2836] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:09:45 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 15:09:51.119694 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:09:51.121136 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:51.211371 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72b44f-2f34-42ef-ae76-2374794e921a service cinder] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:09:51.216525 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baae94f89c07491a875477ede4e06b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:09:51.217238 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:09:51.217649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:09:51.217937 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:09:51.219767 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:09:51.231627 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:09:51.233253 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:09:51.244101 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1425/2837] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:09:51 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:10:07.487424 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f8996-bb51-4177-8081-7e43e788dd73 None None] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:10:07.497106 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f8996-bb51-4177-8081-7e43e788dd73 None None] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:10:07.501226 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a70a0361b648d6a4233546a1d4901d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:10:07.502042 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:10:07.502525 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:10:07.502980 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:10:07.504977 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:10:07.517550 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:10:07.519093 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:10:07.528082 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1413/2838] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:10:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 15:10:17.845613 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:10:17.847021 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:10:17.860651 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17517a27-c1a6-459e-b395-abbddd9125cf service nova] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:10:17.865533 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:10:17.866255 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:10:17.866565 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:10:17.867007 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] PATH_INFO: `/v3/users/8b6c5ce8a6e342b492f56c29d5f8b473` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:10:17.868006 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6c5ce8a6e342b492f56c29d5f8b473)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:10:17.870002 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:10:17.917237 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6c5ce8a6e342b492f56c29d5f8b473'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:17.925082 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6c5ce8a6e342b492f56c29d5f8b473'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:17.925934 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6c5ce8a6e342b492f56c29d5f8b473'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:17.926649 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6c5ce8a6e342b492f56c29d5f8b473'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:17.939068 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6c5ce8a6e342b492f56c29d5f8b473'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:17.952070 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1426/2839] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:10:17 2021] DELETE /identity/v3/users/8b6c5ce8a6e342b492f56c29d5f8b473 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:10:18.174614 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:10:18.184075 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f4a62-7638-47b3-a405-b4db4c8abea6 service neutron] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:10:18.247336 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:10:18.248122 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:10:18.248407 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:10:18.248683 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] PATH_INFO: `/v3/projects/25ba3a1600fd4be6bf9ece5e1fc524e5` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:10:18.249768 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ba3a1600fd4be6bf9ece5e1fc524e5)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:10:18.251691 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:10:18.299886 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ba3a1600fd4be6bf9ece5e1fc524e5', 'request_id': 'req-bc914143-77b1-4000-b65f-17c45e63764a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.304869 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ba3a1600fd4be6bf9ece5e1fc524e5', 'request_id': 'req-bc914143-77b1-4000-b65f-17c45e63764a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.312362 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ba3a1600fd4be6bf9ece5e1fc524e5', 'request_id': 'req-bc914143-77b1-4000-b65f-17c45e63764a'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.328817 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] The token cache is being invalidate because project 25ba3a1600fd4be6bf9ece5e1fc524e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:10:18.329101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.329732 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.331214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1414/2840] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:10:18 2021] DELETE /identity/v3/projects/25ba3a1600fd4be6bf9ece5e1fc524e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:10:18.335183 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:10:18.336559 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:10:18.348673 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53ef6f-a620-48fa-81bd-94903f863318 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:10:18.411003 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:10:18.411832 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:10:18.412112 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:10:18.412386 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] PATH_INFO: `/v3/users/475c710c78ce4d7680cb5f1da29863fc` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:10:18.413473 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=475c710c78ce4d7680cb5f1da29863fc)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:10:18.415405 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:10:18.461638 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '475c710c78ce4d7680cb5f1da29863fc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.467988 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '475c710c78ce4d7680cb5f1da29863fc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.468650 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '475c710c78ce4d7680cb5f1da29863fc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.469252 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '475c710c78ce4d7680cb5f1da29863fc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.480779 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-05c1838a-53fd-4907-a06c-fc787bf650f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '475c710c78ce4d7680cb5f1da29863fc'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.494129 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1427/2841] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:10:18 2021] DELETE /identity/v3/users/475c710c78ce4d7680cb5f1da29863fc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:10:18.720433 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:10:18.721916 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:10:18.735247 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc914143-77b1-4000-b65f-17c45e63764a admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:10:18.798033 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:10:18.798930 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:10:18.799718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:10:18.799718 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] PATH_INFO: `/v3/projects/b8e4cc3babfe4acbbf4dec7921b88394` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:10:18.800680 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e4cc3babfe4acbbf4dec7921b88394)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:10:18.802696 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:10:18.852170 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e4cc3babfe4acbbf4dec7921b88394', 'request_id': 'req-1267ff6a-9b29-4216-9369-de40bef388a6'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.857848 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e4cc3babfe4acbbf4dec7921b88394', 'request_id': 'req-1267ff6a-9b29-4216-9369-de40bef388a6'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.865214 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e4cc3babfe4acbbf4dec7921b88394', 'request_id': 'req-1267ff6a-9b29-4216-9369-de40bef388a6'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.882586 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] The token cache is being invalidate because project b8e4cc3babfe4acbbf4dec7921b88394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:10:18.882871 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.883502 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:10:18.884922 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1415/2842] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:10:18 2021] DELETE /identity/v3/projects/b8e4cc3babfe4acbbf4dec7921b88394 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:10:55.732957 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af422-5d9f-44df-9c1f-3e12384fb562 None None] REQUEST_METHOD: `POST` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:10:55.733470 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af422-5d9f-44df-9c1f-3e12384fb562 None None] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:10:55.733658 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af422-5d9f-44df-9c1f-3e12384fb562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:10:55.757012 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.auth.core [None req-b12af422-5d9f-44df-9c1f-3e12384fb562 None None] MFA Rules not processed for user `20d06ebe071645d8bf13f9950bd65112`. Rule list: `[]` (Enabled: `True`). {{(pid=66562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 15:10:55.758167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b12af422-5d9f-44df-9c1f-3e12384fb562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:10:55.818945 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1428/2843] 10.222.0.57 () {58 vars in 957 bytes} [Mon Oct 25 15:10:55 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 15:10:56.998422 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:10:56.999875 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:10:57.100611 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267ff6a-9b29-4216-9369-de40bef388a6 admin admin] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:10:57.106101 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:10:57.106824 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] REQUEST_METHOD: `GET` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:10:57.107119 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:10:57.107399 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:10:57.109079 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.fernet_utils [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:10:57.120125 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:10:57.121705 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:10:57.130976 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1416/2844] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:10:56 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 15:12:00.456712 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12af422-5d9f-44df-9c1f-3e12384fb562 None None] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:12:00.459367 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-b12af422-5d9f-44df-9c1f-3e12384fb562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:12:00.541813 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12af422-5d9f-44df-9c1f-3e12384fb562 None None] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:12:00.546055 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:12:00.546879 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:12:00.547167 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:12:00.547450 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] PATH_INFO: `/v3/users/20d06ebe071645d8bf13f9950bd65112` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:12:00.548553 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d06ebe071645d8bf13f9950bd65112)` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:12:00.550496 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:12:00.597518 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d06ebe071645d8bf13f9950bd65112'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:00.603531 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d06ebe071645d8bf13f9950bd65112'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:00.604143 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d06ebe071645d8bf13f9950bd65112'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:00.604740 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d06ebe071645d8bf13f9950bd65112'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:00.616596 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.notifications [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d06ebe071645d8bf13f9950bd65112'} {{(pid=66562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:00.629053 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1429/2845] 10.222.0.57 () {58 vars in 1223 bytes} [Mon Oct 25 15:12:00 2021] DELETE /identity/v3/users/20d06ebe071645d8bf13f9950bd65112 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:12:00.857896 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] Authenticating user token {{(pid=66563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:12:00.868357 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64766930-a7f5-4fc7-b3de-ab4b619237d8 service placement] Validating token access rules against request {{(pid=66563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:12:00.930690 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3aab5572b2c402b81621b54bfffba2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de23d66a8de47dbaa30df02a935afe2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:12:00.931477 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:12:00.932293 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] SCRIPT_NAME: `/identity` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:12:00.932579 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] PATH_INFO: `/v3/projects/625aa939803a4496848addf4d08fba77` {{(pid=66563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:12:00.933695 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=625aa939803a4496848addf4d08fba77)` {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:12:00.935587 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] RBAC: Authorization granted {{(pid=66563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:12:00.983202 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625aa939803a4496848addf4d08fba77', 'request_id': 'req-278b9470-d2d8-40b6-bb3d-66824eabf15c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:00.988240 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625aa939803a4496848addf4d08fba77', 'request_id': 'req-278b9470-d2d8-40b6-bb3d-66824eabf15c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:00.995712 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625aa939803a4496848addf4d08fba77', 'request_id': 'req-278b9470-d2d8-40b6-bb3d-66824eabf15c'} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:01.012678 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] The token cache is being invalidate because project 625aa939803a4496848addf4d08fba77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 15:12:01.012964 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:01.013603 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: DEBUG keystone.notifications [None req-278b9470-d2d8-40b6-bb3d-66824eabf15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 15:12:01.015081 dv-cinder-813751-1-iscsi devstack@keystone.service[66563]: [pid: 66563|app: 0|req: 1417/2846] 10.222.0.57 () {58 vars in 1232 bytes} [Mon Oct 25 15:12:00 2021] DELETE /identity/v3/projects/625aa939803a4496848addf4d08fba77 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 15:16:09.853436 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] Authenticating user token {{(pid=66562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 15:16:09.854822 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:16:09.928208 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01994d1a-e814-461f-a7cd-bfdcaa1c8850 admin admin] Validating token access rules against request {{(pid=66562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 15:16:09.991156 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be1b21-1ddb-4e27-9afa-1241ff1dbe9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eca65349f42a4b53aa051474cd1c98d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12549af9dfe0434ebc8a12d37884b63e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 15:16:09.991738 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1b21-1ddb-4e27-9afa-1241ff1dbe9f service placement] REQUEST_METHOD: `GET` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 15:16:09.992029 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1b21-1ddb-4e27-9afa-1241ff1dbe9f service placement] SCRIPT_NAME: `/identity` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 15:16:09.992314 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1b21-1ddb-4e27-9afa-1241ff1dbe9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 15:16:09.993949 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.fernet_utils [None req-47be1b21-1ddb-4e27-9afa-1241ff1dbe9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 15:16:10.004996 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be1b21-1ddb-4e27-9afa-1241ff1dbe9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 15:16:10.006583 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be1b21-1ddb-4e27-9afa-1241ff1dbe9f service placement] RBAC: Authorization granted {{(pid=66562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 15:16:10.015747 dv-cinder-813751-1-iscsi devstack@keystone.service[66562]: [pid: 66562|app: 0|req: 1430/2847] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 25 15:16:09 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)